2023-07-15 03:10:43,476 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-15 03:10:43,743 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad 2023-07-15 03:10:43,744 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-15 03:10:43,744 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-15 03:10:43,796 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-15 03:10:44,117 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-15 03:10:44,118 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/cluster_28d9752d-d2d9-87a3-fd7d-03f24d387c2d, deleteOnExit=true 2023-07-15 03:10:44,118 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-15 03:10:44,119 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/test.cache.data in system properties and HBase conf 2023-07-15 03:10:44,120 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/hadoop.tmp.dir in system properties and HBase conf 2023-07-15 03:10:44,120 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/hadoop.log.dir in system properties and HBase conf 2023-07-15 03:10:44,121 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-15 03:10:44,121 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-15 03:10:44,121 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-15 03:10:44,509 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-15 03:10:44,515 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-15 03:10:44,515 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-15 03:10:44,516 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-15 03:10:44,516 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-15 03:10:44,517 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-15 03:10:44,517 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-15 03:10:44,517 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-15 03:10:44,518 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-15 03:10:44,518 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-15 03:10:44,519 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/nfs.dump.dir in system properties and HBase conf 2023-07-15 03:10:44,519 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/java.io.tmpdir in system properties and HBase conf 2023-07-15 03:10:44,520 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-15 03:10:44,520 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-15 03:10:44,520 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-15 03:10:45,159 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-15 03:10:45,164 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-15 03:10:45,534 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-15 03:10:45,730 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-15 03:10:45,744 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 03:10:45,800 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 03:10:45,854 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/java.io.tmpdir/Jetty_localhost_41169_hdfs____ckeg8x/webapp 2023-07-15 03:10:46,045 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41169 2023-07-15 03:10:46,059 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-15 03:10:46,060 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-15 03:10:46,625 WARN [Listener at localhost/33795] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-15 03:10:46,732 WARN [Listener at localhost/33795] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-15 03:10:46,763 WARN [Listener at localhost/33795] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 03:10:46,821 INFO [Listener at localhost/33795] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 03:10:46,830 INFO [Listener at localhost/33795] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/java.io.tmpdir/Jetty_localhost_34869_datanode____.8fbti7/webapp 2023-07-15 03:10:46,952 INFO [Listener at localhost/33795] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34869 2023-07-15 03:10:47,483 WARN [Listener at localhost/41313] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-15 03:10:47,525 WARN [Listener at localhost/41313] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-15 03:10:47,530 WARN [Listener at localhost/41313] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 03:10:47,532 INFO [Listener at localhost/41313] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 03:10:47,546 INFO [Listener at localhost/41313] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/java.io.tmpdir/Jetty_localhost_46771_datanode____2leh9y/webapp 2023-07-15 03:10:47,656 INFO [Listener at localhost/41313] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46771 2023-07-15 03:10:47,690 WARN [Listener at localhost/34411] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-15 03:10:47,738 WARN [Listener at localhost/34411] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-15 03:10:47,749 WARN [Listener at localhost/34411] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 03:10:47,752 INFO [Listener at localhost/34411] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 03:10:47,762 INFO [Listener at localhost/34411] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/java.io.tmpdir/Jetty_localhost_35443_datanode____9p2ew/webapp 2023-07-15 03:10:47,924 INFO [Listener at localhost/34411] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35443 2023-07-15 03:10:47,950 WARN [Listener at localhost/40311] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-15 03:10:48,318 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1422ec538b541306: Processing first storage report for DS-35ae4036-a90e-4435-afbd-01d63788dde6 from datanode 46c41bb2-1f9c-4dae-b66e-4f8a5bcb14b1 2023-07-15 03:10:48,322 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1422ec538b541306: from storage DS-35ae4036-a90e-4435-afbd-01d63788dde6 node DatanodeRegistration(127.0.0.1:33869, datanodeUuid=46c41bb2-1f9c-4dae-b66e-4f8a5bcb14b1, infoPort=45865, infoSecurePort=0, ipcPort=41313, storageInfo=lv=-57;cid=testClusterID;nsid=1746338121;c=1689390645259), blocks: 0, hasStaleStorage: true, processing time: 3 msecs, invalidatedBlocks: 0 2023-07-15 03:10:48,322 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6e337d42321abd91: Processing first storage report for DS-1f8f8487-c8d3-4406-ac32-b9af8570cdae from datanode ef2a0e98-1584-41b2-9036-9be628929432 2023-07-15 03:10:48,322 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6e337d42321abd91: from storage DS-1f8f8487-c8d3-4406-ac32-b9af8570cdae node DatanodeRegistration(127.0.0.1:39315, datanodeUuid=ef2a0e98-1584-41b2-9036-9be628929432, infoPort=35183, infoSecurePort=0, ipcPort=40311, storageInfo=lv=-57;cid=testClusterID;nsid=1746338121;c=1689390645259), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-15 03:10:48,322 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2dde0fef6d63ba3b: Processing first storage report for DS-cfb748f3-580b-445d-8282-cc9b61c46af1 from datanode df1a242c-a08e-439e-9692-8c68db4e7ebf 2023-07-15 03:10:48,323 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2dde0fef6d63ba3b: from storage DS-cfb748f3-580b-445d-8282-cc9b61c46af1 node DatanodeRegistration(127.0.0.1:42519, datanodeUuid=df1a242c-a08e-439e-9692-8c68db4e7ebf, infoPort=40651, infoSecurePort=0, ipcPort=34411, storageInfo=lv=-57;cid=testClusterID;nsid=1746338121;c=1689390645259), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-15 03:10:48,323 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6e337d42321abd91: Processing first storage report for DS-011299e3-841f-4796-929a-627e68f84e88 from datanode ef2a0e98-1584-41b2-9036-9be628929432 2023-07-15 03:10:48,323 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6e337d42321abd91: from storage DS-011299e3-841f-4796-929a-627e68f84e88 node DatanodeRegistration(127.0.0.1:39315, datanodeUuid=ef2a0e98-1584-41b2-9036-9be628929432, infoPort=35183, infoSecurePort=0, ipcPort=40311, storageInfo=lv=-57;cid=testClusterID;nsid=1746338121;c=1689390645259), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-15 03:10:48,323 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1422ec538b541306: Processing first storage report for DS-4bdb75b6-b110-4aac-bd25-f970423aaafe from datanode 46c41bb2-1f9c-4dae-b66e-4f8a5bcb14b1 2023-07-15 03:10:48,324 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1422ec538b541306: from storage DS-4bdb75b6-b110-4aac-bd25-f970423aaafe node DatanodeRegistration(127.0.0.1:33869, datanodeUuid=46c41bb2-1f9c-4dae-b66e-4f8a5bcb14b1, infoPort=45865, infoSecurePort=0, ipcPort=41313, storageInfo=lv=-57;cid=testClusterID;nsid=1746338121;c=1689390645259), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-15 03:10:48,324 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2dde0fef6d63ba3b: Processing first storage report for DS-45636779-fb2a-441f-b4cb-2cc558a7f9c3 from datanode df1a242c-a08e-439e-9692-8c68db4e7ebf 2023-07-15 03:10:48,324 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2dde0fef6d63ba3b: from storage DS-45636779-fb2a-441f-b4cb-2cc558a7f9c3 node DatanodeRegistration(127.0.0.1:42519, datanodeUuid=df1a242c-a08e-439e-9692-8c68db4e7ebf, infoPort=40651, infoSecurePort=0, ipcPort=34411, storageInfo=lv=-57;cid=testClusterID;nsid=1746338121;c=1689390645259), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-15 03:10:48,539 DEBUG [Listener at localhost/40311] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad 2023-07-15 03:10:48,670 INFO [Listener at localhost/40311] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/cluster_28d9752d-d2d9-87a3-fd7d-03f24d387c2d/zookeeper_0, clientPort=58749, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/cluster_28d9752d-d2d9-87a3-fd7d-03f24d387c2d/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/cluster_28d9752d-d2d9-87a3-fd7d-03f24d387c2d/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-15 03:10:48,695 INFO [Listener at localhost/40311] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58749 2023-07-15 03:10:48,706 INFO [Listener at localhost/40311] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 03:10:48,709 INFO [Listener at localhost/40311] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 03:10:49,454 INFO [Listener at localhost/40311] util.FSUtils(471): Created version file at hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d with version=8 2023-07-15 03:10:49,455 INFO [Listener at localhost/40311] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/hbase-staging 2023-07-15 03:10:49,820 INFO [Listener at localhost/40311] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-15 03:10:50,396 INFO [Listener at localhost/40311] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-15 03:10:50,438 INFO [Listener at localhost/40311] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 03:10:50,439 INFO [Listener at localhost/40311] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-15 03:10:50,439 INFO [Listener at localhost/40311] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-15 03:10:50,439 INFO [Listener at localhost/40311] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 03:10:50,440 INFO [Listener at localhost/40311] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-15 03:10:50,599 INFO [Listener at localhost/40311] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-15 03:10:50,676 DEBUG [Listener at localhost/40311] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-15 03:10:50,782 INFO [Listener at localhost/40311] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45731 2023-07-15 03:10:50,802 INFO [Listener at localhost/40311] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 03:10:50,805 INFO [Listener at localhost/40311] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 03:10:50,831 INFO [Listener at localhost/40311] zookeeper.RecoverableZooKeeper(93): Process identifier=master:45731 connecting to ZooKeeper ensemble=127.0.0.1:58749 2023-07-15 03:10:50,894 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:457310x0, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-15 03:10:50,900 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:45731-0x10166f610420000 connected 2023-07-15 03:10:50,947 DEBUG [Listener at localhost/40311] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 03:10:50,948 DEBUG [Listener at localhost/40311] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 03:10:50,967 DEBUG [Listener at localhost/40311] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-15 03:10:50,984 DEBUG [Listener at localhost/40311] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45731 2023-07-15 03:10:50,985 DEBUG [Listener at localhost/40311] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45731 2023-07-15 03:10:50,990 DEBUG [Listener at localhost/40311] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45731 2023-07-15 03:10:50,995 DEBUG [Listener at localhost/40311] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45731 2023-07-15 03:10:50,996 DEBUG [Listener at localhost/40311] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45731 2023-07-15 03:10:51,005 INFO [Listener at localhost/40311] master.HMaster(444): hbase.rootdir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d, hbase.cluster.distributed=false 2023-07-15 03:10:51,090 INFO [Listener at localhost/40311] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-15 03:10:51,091 INFO [Listener at localhost/40311] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 03:10:51,091 INFO [Listener at localhost/40311] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-15 03:10:51,091 INFO [Listener at localhost/40311] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-15 03:10:51,092 INFO [Listener at localhost/40311] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 03:10:51,092 INFO [Listener at localhost/40311] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-15 03:10:51,099 INFO [Listener at localhost/40311] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-15 03:10:51,106 INFO [Listener at localhost/40311] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40245 2023-07-15 03:10:51,109 INFO [Listener at localhost/40311] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-15 03:10:51,117 INFO [Listener at localhost/40311] mob.MobFileCache(124): MobFileCache disabled 2023-07-15 03:10:51,119 INFO [Listener at localhost/40311] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 03:10:51,121 INFO [Listener at localhost/40311] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 03:10:51,123 INFO [Listener at localhost/40311] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40245 connecting to ZooKeeper ensemble=127.0.0.1:58749 2023-07-15 03:10:51,131 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:402450x0, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-15 03:10:51,133 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40245-0x10166f610420001 connected 2023-07-15 03:10:51,133 DEBUG [Listener at localhost/40311] zookeeper.ZKUtil(164): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 03:10:51,134 DEBUG [Listener at localhost/40311] zookeeper.ZKUtil(164): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 03:10:51,136 DEBUG [Listener at localhost/40311] zookeeper.ZKUtil(164): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-15 03:10:51,142 DEBUG [Listener at localhost/40311] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40245 2023-07-15 03:10:51,143 DEBUG [Listener at localhost/40311] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40245 2023-07-15 03:10:51,143 DEBUG [Listener at localhost/40311] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40245 2023-07-15 03:10:51,144 DEBUG [Listener at localhost/40311] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40245 2023-07-15 03:10:51,145 DEBUG [Listener at localhost/40311] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40245 2023-07-15 03:10:51,159 INFO [Listener at localhost/40311] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-15 03:10:51,160 INFO [Listener at localhost/40311] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 03:10:51,160 INFO [Listener at localhost/40311] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-15 03:10:51,161 INFO [Listener at localhost/40311] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-15 03:10:51,161 INFO [Listener at localhost/40311] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 03:10:51,161 INFO [Listener at localhost/40311] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-15 03:10:51,161 INFO [Listener at localhost/40311] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-15 03:10:51,163 INFO [Listener at localhost/40311] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37439 2023-07-15 03:10:51,163 INFO [Listener at localhost/40311] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-15 03:10:51,166 INFO [Listener at localhost/40311] mob.MobFileCache(124): MobFileCache disabled 2023-07-15 03:10:51,168 INFO [Listener at localhost/40311] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 03:10:51,170 INFO [Listener at localhost/40311] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 03:10:51,171 INFO [Listener at localhost/40311] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37439 connecting to ZooKeeper ensemble=127.0.0.1:58749 2023-07-15 03:10:51,176 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:374390x0, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-15 03:10:51,177 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:37439-0x10166f610420002 connected 2023-07-15 03:10:51,177 DEBUG [Listener at localhost/40311] zookeeper.ZKUtil(164): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 03:10:51,178 DEBUG [Listener at localhost/40311] zookeeper.ZKUtil(164): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 03:10:51,179 DEBUG [Listener at localhost/40311] zookeeper.ZKUtil(164): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-15 03:10:51,186 DEBUG [Listener at localhost/40311] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37439 2023-07-15 03:10:51,187 DEBUG [Listener at localhost/40311] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37439 2023-07-15 03:10:51,190 DEBUG [Listener at localhost/40311] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37439 2023-07-15 03:10:51,191 DEBUG [Listener at localhost/40311] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37439 2023-07-15 03:10:51,193 DEBUG [Listener at localhost/40311] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37439 2023-07-15 03:10:51,213 INFO [Listener at localhost/40311] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-15 03:10:51,213 INFO [Listener at localhost/40311] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 03:10:51,213 INFO [Listener at localhost/40311] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-15 03:10:51,214 INFO [Listener at localhost/40311] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-15 03:10:51,214 INFO [Listener at localhost/40311] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 03:10:51,214 INFO [Listener at localhost/40311] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-15 03:10:51,214 INFO [Listener at localhost/40311] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-15 03:10:51,216 INFO [Listener at localhost/40311] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43379 2023-07-15 03:10:51,217 INFO [Listener at localhost/40311] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-15 03:10:51,218 INFO [Listener at localhost/40311] mob.MobFileCache(124): MobFileCache disabled 2023-07-15 03:10:51,219 INFO [Listener at localhost/40311] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 03:10:51,223 INFO [Listener at localhost/40311] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 03:10:51,225 INFO [Listener at localhost/40311] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43379 connecting to ZooKeeper ensemble=127.0.0.1:58749 2023-07-15 03:10:51,237 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:433790x0, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-15 03:10:51,238 DEBUG [Listener at localhost/40311] zookeeper.ZKUtil(164): regionserver:433790x0, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 03:10:51,238 DEBUG [Listener at localhost/40311] zookeeper.ZKUtil(164): regionserver:433790x0, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 03:10:51,240 DEBUG [Listener at localhost/40311] zookeeper.ZKUtil(164): regionserver:433790x0, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-15 03:10:51,245 DEBUG [Listener at localhost/40311] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43379 2023-07-15 03:10:51,246 DEBUG [Listener at localhost/40311] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43379 2023-07-15 03:10:51,247 DEBUG [Listener at localhost/40311] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43379 2023-07-15 03:10:51,247 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43379-0x10166f610420003 connected 2023-07-15 03:10:51,248 DEBUG [Listener at localhost/40311] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43379 2023-07-15 03:10:51,248 DEBUG [Listener at localhost/40311] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43379 2023-07-15 03:10:51,252 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,45731,1689390649632 2023-07-15 03:10:51,263 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-15 03:10:51,265 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,45731,1689390649632 2023-07-15 03:10:51,292 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-15 03:10:51,292 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-15 03:10:51,292 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-15 03:10:51,292 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 03:10:51,292 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-15 03:10:51,294 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-15 03:10:51,296 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,45731,1689390649632 from backup master directory 2023-07-15 03:10:51,296 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-15 03:10:51,302 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,45731,1689390649632 2023-07-15 03:10:51,302 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-15 03:10:51,315 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-15 03:10:51,315 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,45731,1689390649632 2023-07-15 03:10:51,320 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-15 03:10:51,322 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-15 03:10:51,442 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/hbase.id with ID: f7c12159-6e2e-4893-a755-3548c8233f48 2023-07-15 03:10:51,491 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 03:10:51,510 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 03:10:51,586 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x46c1acb5 to 127.0.0.1:58749 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:10:51,636 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@49cbe7d1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:10:51,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 03:10:51,673 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-15 03:10:51,697 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-15 03:10:51,697 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-15 03:10:51,700 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-15 03:10:51,706 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-15 03:10:51,708 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 03:10:51,760 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/MasterData/data/master/store-tmp 2023-07-15 03:10:51,820 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:10:51,821 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-15 03:10:51,821 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 03:10:51,821 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 03:10:51,821 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-15 03:10:51,821 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 03:10:51,821 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 03:10:51,821 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-15 03:10:51,823 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/MasterData/WALs/jenkins-hbase4.apache.org,45731,1689390649632 2023-07-15 03:10:51,854 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45731%2C1689390649632, suffix=, logDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/MasterData/WALs/jenkins-hbase4.apache.org,45731,1689390649632, archiveDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/MasterData/oldWALs, maxLogs=10 2023-07-15 03:10:51,957 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39315,DS-1f8f8487-c8d3-4406-ac32-b9af8570cdae,DISK] 2023-07-15 03:10:51,957 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42519,DS-cfb748f3-580b-445d-8282-cc9b61c46af1,DISK] 2023-07-15 03:10:51,957 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33869,DS-35ae4036-a90e-4435-afbd-01d63788dde6,DISK] 2023-07-15 03:10:51,986 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-15 03:10:52,074 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/MasterData/WALs/jenkins-hbase4.apache.org,45731,1689390649632/jenkins-hbase4.apache.org%2C45731%2C1689390649632.1689390651871 2023-07-15 03:10:52,076 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33869,DS-35ae4036-a90e-4435-afbd-01d63788dde6,DISK], DatanodeInfoWithStorage[127.0.0.1:42519,DS-cfb748f3-580b-445d-8282-cc9b61c46af1,DISK], DatanodeInfoWithStorage[127.0.0.1:39315,DS-1f8f8487-c8d3-4406-ac32-b9af8570cdae,DISK]] 2023-07-15 03:10:52,077 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-15 03:10:52,077 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:10:52,082 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-15 03:10:52,083 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-15 03:10:52,181 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-15 03:10:52,198 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-15 03:10:52,241 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-15 03:10:52,255 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:10:52,262 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-15 03:10:52,267 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-15 03:10:52,290 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-15 03:10:52,296 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 03:10:52,297 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71666391, jitterRate=0.06791244447231293}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 03:10:52,297 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-15 03:10:52,299 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-15 03:10:52,331 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-15 03:10:52,331 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-15 03:10:52,336 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-15 03:10:52,340 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 3 msec 2023-07-15 03:10:52,383 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 42 msec 2023-07-15 03:10:52,383 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-15 03:10:52,417 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-15 03:10:52,423 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-15 03:10:52,451 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-15 03:10:52,457 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-15 03:10:52,458 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-15 03:10:52,464 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-15 03:10:52,468 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-15 03:10:52,472 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 03:10:52,474 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-15 03:10:52,474 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-15 03:10:52,493 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-15 03:10:52,500 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-15 03:10:52,500 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-15 03:10:52,500 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-15 03:10:52,500 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-15 03:10:52,500 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 03:10:52,501 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,45731,1689390649632, sessionid=0x10166f610420000, setting cluster-up flag (Was=false) 2023-07-15 03:10:52,525 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 03:10:52,531 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-15 03:10:52,533 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45731,1689390649632 2023-07-15 03:10:52,539 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 03:10:52,547 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-15 03:10:52,548 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45731,1689390649632 2023-07-15 03:10:52,552 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp 2023-07-15 03:10:52,558 INFO [RS:0;jenkins-hbase4:40245] regionserver.HRegionServer(951): ClusterId : f7c12159-6e2e-4893-a755-3548c8233f48 2023-07-15 03:10:52,564 INFO [RS:1;jenkins-hbase4:37439] regionserver.HRegionServer(951): ClusterId : f7c12159-6e2e-4893-a755-3548c8233f48 2023-07-15 03:10:52,574 INFO [RS:2;jenkins-hbase4:43379] regionserver.HRegionServer(951): ClusterId : f7c12159-6e2e-4893-a755-3548c8233f48 2023-07-15 03:10:52,579 DEBUG [RS:1;jenkins-hbase4:37439] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-15 03:10:52,579 DEBUG [RS:0;jenkins-hbase4:40245] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-15 03:10:52,579 DEBUG [RS:2;jenkins-hbase4:43379] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-15 03:10:52,586 DEBUG [RS:1;jenkins-hbase4:37439] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-15 03:10:52,586 DEBUG [RS:0;jenkins-hbase4:40245] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-15 03:10:52,586 DEBUG [RS:2;jenkins-hbase4:43379] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-15 03:10:52,586 DEBUG [RS:0;jenkins-hbase4:40245] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-15 03:10:52,586 DEBUG [RS:1;jenkins-hbase4:37439] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-15 03:10:52,587 DEBUG [RS:2;jenkins-hbase4:43379] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-15 03:10:52,599 DEBUG [RS:1;jenkins-hbase4:37439] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-15 03:10:52,600 DEBUG [RS:0;jenkins-hbase4:40245] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-15 03:10:52,599 DEBUG [RS:2;jenkins-hbase4:43379] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-15 03:10:52,601 DEBUG [RS:1;jenkins-hbase4:37439] zookeeper.ReadOnlyZKClient(139): Connect 0x2e7a8c53 to 127.0.0.1:58749 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:10:52,606 DEBUG [RS:2;jenkins-hbase4:43379] zookeeper.ReadOnlyZKClient(139): Connect 0x6a62bf71 to 127.0.0.1:58749 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:10:52,607 DEBUG [RS:0;jenkins-hbase4:40245] zookeeper.ReadOnlyZKClient(139): Connect 0x2e41f9c8 to 127.0.0.1:58749 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:10:52,629 DEBUG [RS:2;jenkins-hbase4:43379] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64a54c4d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:10:52,630 DEBUG [RS:2;jenkins-hbase4:43379] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@609ad401, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-15 03:10:52,636 DEBUG [RS:1;jenkins-hbase4:37439] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20bd77ec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:10:52,636 DEBUG [RS:0;jenkins-hbase4:40245] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20860270, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:10:52,636 DEBUG [RS:1;jenkins-hbase4:37439] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2482e723, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-15 03:10:52,637 DEBUG [RS:0;jenkins-hbase4:40245] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24b992b8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-15 03:10:52,671 DEBUG [RS:2;jenkins-hbase4:43379] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:43379 2023-07-15 03:10:52,679 INFO [RS:2;jenkins-hbase4:43379] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-15 03:10:52,679 INFO [RS:2;jenkins-hbase4:43379] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-15 03:10:52,682 DEBUG [RS:1;jenkins-hbase4:37439] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:37439 2023-07-15 03:10:52,681 DEBUG [RS:0;jenkins-hbase4:40245] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:40245 2023-07-15 03:10:52,683 INFO [RS:0;jenkins-hbase4:40245] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-15 03:10:52,683 INFO [RS:0;jenkins-hbase4:40245] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-15 03:10:52,682 INFO [RS:1;jenkins-hbase4:37439] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-15 03:10:52,683 INFO [RS:1;jenkins-hbase4:37439] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-15 03:10:52,709 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-15 03:10:52,709 DEBUG [RS:0;jenkins-hbase4:40245] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-15 03:10:52,709 DEBUG [RS:1;jenkins-hbase4:37439] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-15 03:10:52,709 DEBUG [RS:2;jenkins-hbase4:43379] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-15 03:10:52,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 03:10:52,712 INFO [RS:2;jenkins-hbase4:43379] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 03:10:52,712 DEBUG [RS:2;jenkins-hbase4:43379] regionserver.HRegionServer(1022): About to register with Master. 2023-07-15 03:10:52,712 INFO [RS:1;jenkins-hbase4:37439] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 03:10:52,713 DEBUG [RS:1;jenkins-hbase4:37439] regionserver.HRegionServer(1022): About to register with Master. 2023-07-15 03:10:52,711 INFO [RS:0;jenkins-hbase4:40245] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 03:10:52,713 DEBUG [RS:0;jenkins-hbase4:40245] regionserver.HRegionServer(1022): About to register with Master. 2023-07-15 03:10:52,716 INFO [RS:2;jenkins-hbase4:43379] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45731,1689390649632 with isa=jenkins-hbase4.apache.org/172.31.14.131:43379, startcode=1689390651212 2023-07-15 03:10:52,716 INFO [RS:0;jenkins-hbase4:40245] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45731,1689390649632 with isa=jenkins-hbase4.apache.org/172.31.14.131:40245, startcode=1689390651089 2023-07-15 03:10:52,716 INFO [RS:1;jenkins-hbase4:37439] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45731,1689390649632 with isa=jenkins-hbase4.apache.org/172.31.14.131:37439, startcode=1689390651159 2023-07-15 03:10:52,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-15 03:10:52,746 DEBUG [RS:1;jenkins-hbase4:37439] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-15 03:10:52,747 DEBUG [RS:2;jenkins-hbase4:43379] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-15 03:10:52,746 DEBUG [RS:0;jenkins-hbase4:40245] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-15 03:10:52,861 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51519, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-15 03:10:52,862 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44011, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-15 03:10:52,863 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34391, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-15 03:10:52,880 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45731] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-15 03:10:52,888 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-15 03:10:52,889 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45731] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-15 03:10:52,893 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45731] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-15 03:10:52,907 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 03:10:52,907 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 03:10:52,907 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 03:10:52,908 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 03:10:52,908 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-15 03:10:52,908 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:52,908 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-15 03:10:52,908 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:52,920 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689390682919 2023-07-15 03:10:52,923 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-15 03:10:52,924 DEBUG [RS:2;jenkins-hbase4:43379] regionserver.HRegionServer(2830): Master is not running yet 2023-07-15 03:10:52,924 DEBUG [RS:0;jenkins-hbase4:40245] regionserver.HRegionServer(2830): Master is not running yet 2023-07-15 03:10:52,924 WARN [RS:2;jenkins-hbase4:43379] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-15 03:10:52,925 DEBUG [RS:1;jenkins-hbase4:37439] regionserver.HRegionServer(2830): Master is not running yet 2023-07-15 03:10:52,925 WARN [RS:1;jenkins-hbase4:37439] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-15 03:10:52,925 WARN [RS:0;jenkins-hbase4:40245] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-15 03:10:52,927 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-15 03:10:52,928 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-15 03:10:52,936 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-15 03:10:52,937 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-15 03:10:52,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-15 03:10:52,947 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-15 03:10:52,948 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-15 03:10:52,948 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-15 03:10:52,949 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:52,951 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-15 03:10:52,954 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-15 03:10:52,954 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-15 03:10:52,958 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-15 03:10:52,959 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-15 03:10:52,967 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689390652964,5,FailOnTimeoutGroup] 2023-07-15 03:10:52,968 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689390652967,5,FailOnTimeoutGroup] 2023-07-15 03:10:52,968 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:52,969 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-15 03:10:52,972 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:52,972 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:53,011 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-15 03:10:53,013 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-15 03:10:53,013 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d 2023-07-15 03:10:53,027 INFO [RS:1;jenkins-hbase4:37439] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45731,1689390649632 with isa=jenkins-hbase4.apache.org/172.31.14.131:37439, startcode=1689390651159 2023-07-15 03:10:53,027 INFO [RS:2;jenkins-hbase4:43379] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45731,1689390649632 with isa=jenkins-hbase4.apache.org/172.31.14.131:43379, startcode=1689390651212 2023-07-15 03:10:53,027 INFO [RS:0;jenkins-hbase4:40245] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45731,1689390649632 with isa=jenkins-hbase4.apache.org/172.31.14.131:40245, startcode=1689390651089 2023-07-15 03:10:53,035 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45731] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:10:53,041 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45731] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:10:53,042 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45731] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:10:53,049 DEBUG [RS:0;jenkins-hbase4:40245] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d 2023-07-15 03:10:53,049 DEBUG [RS:1;jenkins-hbase4:37439] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d 2023-07-15 03:10:53,049 DEBUG [RS:2;jenkins-hbase4:43379] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d 2023-07-15 03:10:53,050 DEBUG [RS:1;jenkins-hbase4:37439] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33795 2023-07-15 03:10:53,050 DEBUG [RS:0;jenkins-hbase4:40245] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33795 2023-07-15 03:10:53,053 DEBUG [RS:1;jenkins-hbase4:37439] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-15 03:10:53,052 DEBUG [RS:2;jenkins-hbase4:43379] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33795 2023-07-15 03:10:53,053 DEBUG [RS:0;jenkins-hbase4:40245] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-15 03:10:53,053 DEBUG [RS:2;jenkins-hbase4:43379] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-15 03:10:53,064 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 03:10:53,065 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:10:53,068 DEBUG [RS:0;jenkins-hbase4:40245] zookeeper.ZKUtil(162): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:10:53,068 DEBUG [RS:1;jenkins-hbase4:37439] zookeeper.ZKUtil(162): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:10:53,068 DEBUG [RS:2;jenkins-hbase4:43379] zookeeper.ZKUtil(162): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:10:53,068 WARN [RS:0;jenkins-hbase4:40245] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-15 03:10:53,069 WARN [RS:2;jenkins-hbase4:43379] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-15 03:10:53,070 INFO [RS:0;jenkins-hbase4:40245] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 03:10:53,070 INFO [RS:2;jenkins-hbase4:43379] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 03:10:53,071 DEBUG [RS:0;jenkins-hbase4:40245] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/WALs/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:10:53,071 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-15 03:10:53,068 WARN [RS:1;jenkins-hbase4:37439] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-15 03:10:53,071 DEBUG [RS:2;jenkins-hbase4:43379] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/WALs/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:10:53,069 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43379,1689390651212] 2023-07-15 03:10:53,076 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40245,1689390651089] 2023-07-15 03:10:53,076 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37439,1689390651159] 2023-07-15 03:10:53,077 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/meta/1588230740/info 2023-07-15 03:10:53,075 INFO [RS:1;jenkins-hbase4:37439] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 03:10:53,078 DEBUG [RS:1;jenkins-hbase4:37439] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/WALs/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:10:53,078 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-15 03:10:53,080 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:10:53,080 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-15 03:10:53,084 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/meta/1588230740/rep_barrier 2023-07-15 03:10:53,084 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-15 03:10:53,085 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:10:53,085 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-15 03:10:53,086 DEBUG [RS:0;jenkins-hbase4:40245] zookeeper.ZKUtil(162): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:10:53,088 DEBUG [RS:0;jenkins-hbase4:40245] zookeeper.ZKUtil(162): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:10:53,089 DEBUG [RS:0;jenkins-hbase4:40245] zookeeper.ZKUtil(162): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:10:53,090 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/meta/1588230740/table 2023-07-15 03:10:53,091 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-15 03:10:53,092 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:10:53,092 DEBUG [RS:2;jenkins-hbase4:43379] zookeeper.ZKUtil(162): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:10:53,093 DEBUG [RS:2;jenkins-hbase4:43379] zookeeper.ZKUtil(162): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:10:53,094 DEBUG [RS:1;jenkins-hbase4:37439] zookeeper.ZKUtil(162): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:10:53,094 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/meta/1588230740 2023-07-15 03:10:53,094 DEBUG [RS:2;jenkins-hbase4:43379] zookeeper.ZKUtil(162): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:10:53,094 DEBUG [RS:1;jenkins-hbase4:37439] zookeeper.ZKUtil(162): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:10:53,095 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/meta/1588230740 2023-07-15 03:10:53,095 DEBUG [RS:1;jenkins-hbase4:37439] zookeeper.ZKUtil(162): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:10:53,099 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-15 03:10:53,102 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-15 03:10:53,109 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 03:10:53,110 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67327870, jitterRate=0.0032634437084198}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-15 03:10:53,110 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-15 03:10:53,111 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-15 03:10:53,111 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-15 03:10:53,111 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-15 03:10:53,111 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-15 03:10:53,111 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-15 03:10:53,115 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-15 03:10:53,116 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-15 03:10:53,122 DEBUG [RS:1;jenkins-hbase4:37439] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-15 03:10:53,122 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-15 03:10:53,122 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-15 03:10:53,122 DEBUG [RS:0;jenkins-hbase4:40245] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-15 03:10:53,128 DEBUG [RS:2;jenkins-hbase4:43379] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-15 03:10:53,140 INFO [RS:2;jenkins-hbase4:43379] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-15 03:10:53,140 INFO [RS:0;jenkins-hbase4:40245] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-15 03:10:53,140 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-15 03:10:53,140 INFO [RS:1;jenkins-hbase4:37439] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-15 03:10:53,158 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-15 03:10:53,166 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-15 03:10:53,172 INFO [RS:0;jenkins-hbase4:40245] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-15 03:10:53,175 INFO [RS:2;jenkins-hbase4:43379] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-15 03:10:53,172 INFO [RS:1;jenkins-hbase4:37439] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-15 03:10:53,191 INFO [RS:1;jenkins-hbase4:37439] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-15 03:10:53,191 INFO [RS:1;jenkins-hbase4:37439] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:53,207 INFO [RS:1;jenkins-hbase4:37439] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-15 03:10:53,193 INFO [RS:2;jenkins-hbase4:43379] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-15 03:10:53,193 INFO [RS:0;jenkins-hbase4:40245] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-15 03:10:53,221 INFO [RS:0;jenkins-hbase4:40245] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:53,222 INFO [RS:0;jenkins-hbase4:40245] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-15 03:10:53,220 INFO [RS:2;jenkins-hbase4:43379] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:53,223 INFO [RS:2;jenkins-hbase4:43379] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-15 03:10:53,232 INFO [RS:2;jenkins-hbase4:43379] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:53,232 DEBUG [RS:2;jenkins-hbase4:43379] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,232 DEBUG [RS:2;jenkins-hbase4:43379] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,232 DEBUG [RS:2;jenkins-hbase4:43379] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,233 DEBUG [RS:2;jenkins-hbase4:43379] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,233 DEBUG [RS:2;jenkins-hbase4:43379] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,232 INFO [RS:1;jenkins-hbase4:37439] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:53,233 DEBUG [RS:2;jenkins-hbase4:43379] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-15 03:10:53,233 DEBUG [RS:1;jenkins-hbase4:37439] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,234 DEBUG [RS:2;jenkins-hbase4:43379] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,234 DEBUG [RS:1;jenkins-hbase4:37439] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,234 DEBUG [RS:2;jenkins-hbase4:43379] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,234 DEBUG [RS:1;jenkins-hbase4:37439] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,234 DEBUG [RS:2;jenkins-hbase4:43379] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,234 DEBUG [RS:1;jenkins-hbase4:37439] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,234 DEBUG [RS:2;jenkins-hbase4:43379] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,234 DEBUG [RS:1;jenkins-hbase4:37439] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,234 DEBUG [RS:1;jenkins-hbase4:37439] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-15 03:10:53,234 DEBUG [RS:1;jenkins-hbase4:37439] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,235 DEBUG [RS:1;jenkins-hbase4:37439] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,235 DEBUG [RS:1;jenkins-hbase4:37439] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,235 DEBUG [RS:1;jenkins-hbase4:37439] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,235 INFO [RS:2;jenkins-hbase4:43379] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:53,236 INFO [RS:2;jenkins-hbase4:43379] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:53,236 INFO [RS:2;jenkins-hbase4:43379] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:53,239 INFO [RS:0;jenkins-hbase4:40245] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:53,239 DEBUG [RS:0;jenkins-hbase4:40245] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,239 DEBUG [RS:0;jenkins-hbase4:40245] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,240 DEBUG [RS:0;jenkins-hbase4:40245] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,240 DEBUG [RS:0;jenkins-hbase4:40245] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,240 DEBUG [RS:0;jenkins-hbase4:40245] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,240 DEBUG [RS:0;jenkins-hbase4:40245] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-15 03:10:53,240 DEBUG [RS:0;jenkins-hbase4:40245] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,240 DEBUG [RS:0;jenkins-hbase4:40245] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,242 DEBUG [RS:0;jenkins-hbase4:40245] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,242 INFO [RS:1;jenkins-hbase4:37439] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:53,243 INFO [RS:1;jenkins-hbase4:37439] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:53,243 DEBUG [RS:0;jenkins-hbase4:40245] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 03:10:53,243 INFO [RS:1;jenkins-hbase4:37439] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:53,248 INFO [RS:0;jenkins-hbase4:40245] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:53,248 INFO [RS:0;jenkins-hbase4:40245] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:53,248 INFO [RS:0;jenkins-hbase4:40245] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:53,267 INFO [RS:2;jenkins-hbase4:43379] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-15 03:10:53,267 INFO [RS:0;jenkins-hbase4:40245] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-15 03:10:53,271 INFO [RS:1;jenkins-hbase4:37439] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-15 03:10:53,274 INFO [RS:2;jenkins-hbase4:43379] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43379,1689390651212-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:53,281 INFO [RS:0;jenkins-hbase4:40245] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40245,1689390651089-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:53,285 INFO [RS:1;jenkins-hbase4:37439] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37439,1689390651159-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:53,319 DEBUG [jenkins-hbase4:45731] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-15 03:10:53,324 DEBUG [jenkins-hbase4:45731] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 03:10:53,332 DEBUG [jenkins-hbase4:45731] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 03:10:53,332 DEBUG [jenkins-hbase4:45731] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 03:10:53,332 DEBUG [jenkins-hbase4:45731] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 03:10:53,333 DEBUG [jenkins-hbase4:45731] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 03:10:53,338 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37439,1689390651159, state=OPENING 2023-07-15 03:10:53,340 INFO [RS:1;jenkins-hbase4:37439] regionserver.Replication(203): jenkins-hbase4.apache.org,37439,1689390651159 started 2023-07-15 03:10:53,340 INFO [RS:1;jenkins-hbase4:37439] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,37439,1689390651159, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37439, sessionid=0x10166f610420002 2023-07-15 03:10:53,345 INFO [RS:0;jenkins-hbase4:40245] regionserver.Replication(203): jenkins-hbase4.apache.org,40245,1689390651089 started 2023-07-15 03:10:53,345 DEBUG [RS:1;jenkins-hbase4:37439] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-15 03:10:53,345 INFO [RS:2;jenkins-hbase4:43379] regionserver.Replication(203): jenkins-hbase4.apache.org,43379,1689390651212 started 2023-07-15 03:10:53,345 INFO [RS:0;jenkins-hbase4:40245] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,40245,1689390651089, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40245, sessionid=0x10166f610420001 2023-07-15 03:10:53,346 INFO [RS:2;jenkins-hbase4:43379] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,43379,1689390651212, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43379, sessionid=0x10166f610420003 2023-07-15 03:10:53,346 DEBUG [RS:0;jenkins-hbase4:40245] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-15 03:10:53,346 DEBUG [RS:2;jenkins-hbase4:43379] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-15 03:10:53,347 DEBUG [RS:2;jenkins-hbase4:43379] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:10:53,347 DEBUG [RS:2;jenkins-hbase4:43379] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43379,1689390651212' 2023-07-15 03:10:53,347 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-15 03:10:53,345 DEBUG [RS:1;jenkins-hbase4:37439] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:10:53,347 DEBUG [RS:2;jenkins-hbase4:43379] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 03:10:53,346 DEBUG [RS:0;jenkins-hbase4:40245] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:10:53,348 DEBUG [RS:0;jenkins-hbase4:40245] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40245,1689390651089' 2023-07-15 03:10:53,348 DEBUG [RS:0;jenkins-hbase4:40245] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 03:10:53,347 DEBUG [RS:1;jenkins-hbase4:37439] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37439,1689390651159' 2023-07-15 03:10:53,348 DEBUG [RS:1;jenkins-hbase4:37439] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 03:10:53,349 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 03:10:53,350 DEBUG [RS:2;jenkins-hbase4:43379] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 03:10:53,350 DEBUG [RS:1;jenkins-hbase4:37439] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 03:10:53,350 DEBUG [RS:0;jenkins-hbase4:40245] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 03:10:53,351 DEBUG [RS:2;jenkins-hbase4:43379] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-15 03:10:53,351 DEBUG [RS:2;jenkins-hbase4:43379] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-15 03:10:53,351 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-15 03:10:53,351 DEBUG [RS:2;jenkins-hbase4:43379] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:10:53,351 DEBUG [RS:2;jenkins-hbase4:43379] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43379,1689390651212' 2023-07-15 03:10:53,351 DEBUG [RS:2;jenkins-hbase4:43379] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:10:53,351 DEBUG [RS:0;jenkins-hbase4:40245] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-15 03:10:53,351 DEBUG [RS:0;jenkins-hbase4:40245] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-15 03:10:53,351 DEBUG [RS:1;jenkins-hbase4:37439] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-15 03:10:53,351 DEBUG [RS:1;jenkins-hbase4:37439] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-15 03:10:53,352 DEBUG [RS:1;jenkins-hbase4:37439] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:10:53,352 DEBUG [RS:1;jenkins-hbase4:37439] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37439,1689390651159' 2023-07-15 03:10:53,352 DEBUG [RS:1;jenkins-hbase4:37439] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:10:53,351 DEBUG [RS:0;jenkins-hbase4:40245] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:10:53,352 DEBUG [RS:0;jenkins-hbase4:40245] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40245,1689390651089' 2023-07-15 03:10:53,352 DEBUG [RS:0;jenkins-hbase4:40245] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:10:53,355 DEBUG [RS:0;jenkins-hbase4:40245] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:10:53,355 DEBUG [RS:2;jenkins-hbase4:43379] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:10:53,356 DEBUG [RS:1;jenkins-hbase4:37439] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:10:53,359 DEBUG [RS:0;jenkins-hbase4:40245] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-15 03:10:53,359 DEBUG [RS:2;jenkins-hbase4:43379] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-15 03:10:53,359 INFO [RS:0;jenkins-hbase4:40245] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-15 03:10:53,359 INFO [RS:0;jenkins-hbase4:40245] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-15 03:10:53,356 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37439,1689390651159}] 2023-07-15 03:10:53,362 DEBUG [RS:1;jenkins-hbase4:37439] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-15 03:10:53,362 INFO [RS:1;jenkins-hbase4:37439] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-15 03:10:53,359 INFO [RS:2;jenkins-hbase4:43379] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-15 03:10:53,363 INFO [RS:2;jenkins-hbase4:43379] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-15 03:10:53,362 INFO [RS:1;jenkins-hbase4:37439] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-15 03:10:53,475 INFO [RS:1;jenkins-hbase4:37439] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37439%2C1689390651159, suffix=, logDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/WALs/jenkins-hbase4.apache.org,37439,1689390651159, archiveDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/oldWALs, maxLogs=32 2023-07-15 03:10:53,476 INFO [RS:0;jenkins-hbase4:40245] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40245%2C1689390651089, suffix=, logDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/WALs/jenkins-hbase4.apache.org,40245,1689390651089, archiveDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/oldWALs, maxLogs=32 2023-07-15 03:10:53,479 INFO [RS:2;jenkins-hbase4:43379] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43379%2C1689390651212, suffix=, logDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/WALs/jenkins-hbase4.apache.org,43379,1689390651212, archiveDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/oldWALs, maxLogs=32 2023-07-15 03:10:53,557 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39315,DS-1f8f8487-c8d3-4406-ac32-b9af8570cdae,DISK] 2023-07-15 03:10:53,557 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33869,DS-35ae4036-a90e-4435-afbd-01d63788dde6,DISK] 2023-07-15 03:10:53,559 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42519,DS-cfb748f3-580b-445d-8282-cc9b61c46af1,DISK] 2023-07-15 03:10:53,562 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42519,DS-cfb748f3-580b-445d-8282-cc9b61c46af1,DISK] 2023-07-15 03:10:53,562 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39315,DS-1f8f8487-c8d3-4406-ac32-b9af8570cdae,DISK] 2023-07-15 03:10:53,564 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33869,DS-35ae4036-a90e-4435-afbd-01d63788dde6,DISK] 2023-07-15 03:10:53,585 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:10:53,588 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 03:10:53,596 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42519,DS-cfb748f3-580b-445d-8282-cc9b61c46af1,DISK] 2023-07-15 03:10:53,596 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39315,DS-1f8f8487-c8d3-4406-ac32-b9af8570cdae,DISK] 2023-07-15 03:10:53,596 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33869,DS-35ae4036-a90e-4435-afbd-01d63788dde6,DISK] 2023-07-15 03:10:53,605 INFO [RS:2;jenkins-hbase4:43379] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/WALs/jenkins-hbase4.apache.org,43379,1689390651212/jenkins-hbase4.apache.org%2C43379%2C1689390651212.1689390653481 2023-07-15 03:10:53,616 DEBUG [RS:2;jenkins-hbase4:43379] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42519,DS-cfb748f3-580b-445d-8282-cc9b61c46af1,DISK], DatanodeInfoWithStorage[127.0.0.1:39315,DS-1f8f8487-c8d3-4406-ac32-b9af8570cdae,DISK], DatanodeInfoWithStorage[127.0.0.1:33869,DS-35ae4036-a90e-4435-afbd-01d63788dde6,DISK]] 2023-07-15 03:10:53,618 INFO [RS:1;jenkins-hbase4:37439] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/WALs/jenkins-hbase4.apache.org,37439,1689390651159/jenkins-hbase4.apache.org%2C37439%2C1689390651159.1689390653481 2023-07-15 03:10:53,618 DEBUG [RS:1;jenkins-hbase4:37439] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42519,DS-cfb748f3-580b-445d-8282-cc9b61c46af1,DISK], DatanodeInfoWithStorage[127.0.0.1:39315,DS-1f8f8487-c8d3-4406-ac32-b9af8570cdae,DISK], DatanodeInfoWithStorage[127.0.0.1:33869,DS-35ae4036-a90e-4435-afbd-01d63788dde6,DISK]] 2023-07-15 03:10:53,624 INFO [RS:0;jenkins-hbase4:40245] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/WALs/jenkins-hbase4.apache.org,40245,1689390651089/jenkins-hbase4.apache.org%2C40245%2C1689390651089.1689390653481 2023-07-15 03:10:53,627 DEBUG [RS:0;jenkins-hbase4:40245] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33869,DS-35ae4036-a90e-4435-afbd-01d63788dde6,DISK], DatanodeInfoWithStorage[127.0.0.1:42519,DS-cfb748f3-580b-445d-8282-cc9b61c46af1,DISK], DatanodeInfoWithStorage[127.0.0.1:39315,DS-1f8f8487-c8d3-4406-ac32-b9af8570cdae,DISK]] 2023-07-15 03:10:53,643 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44526, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 03:10:53,665 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-15 03:10:53,666 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 03:10:53,672 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37439%2C1689390651159.meta, suffix=.meta, logDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/WALs/jenkins-hbase4.apache.org,37439,1689390651159, archiveDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/oldWALs, maxLogs=32 2023-07-15 03:10:53,708 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42519,DS-cfb748f3-580b-445d-8282-cc9b61c46af1,DISK] 2023-07-15 03:10:53,716 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39315,DS-1f8f8487-c8d3-4406-ac32-b9af8570cdae,DISK] 2023-07-15 03:10:53,716 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33869,DS-35ae4036-a90e-4435-afbd-01d63788dde6,DISK] 2023-07-15 03:10:53,728 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/WALs/jenkins-hbase4.apache.org,37439,1689390651159/jenkins-hbase4.apache.org%2C37439%2C1689390651159.meta.1689390653679.meta 2023-07-15 03:10:53,730 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42519,DS-cfb748f3-580b-445d-8282-cc9b61c46af1,DISK], DatanodeInfoWithStorage[127.0.0.1:39315,DS-1f8f8487-c8d3-4406-ac32-b9af8570cdae,DISK], DatanodeInfoWithStorage[127.0.0.1:33869,DS-35ae4036-a90e-4435-afbd-01d63788dde6,DISK]] 2023-07-15 03:10:53,731 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-15 03:10:53,732 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-15 03:10:53,734 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 03:10:53,736 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-15 03:10:53,739 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-15 03:10:53,741 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-15 03:10:53,760 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-15 03:10:53,760 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:10:53,760 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-15 03:10:53,760 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-15 03:10:53,767 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-15 03:10:53,769 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/meta/1588230740/info 2023-07-15 03:10:53,769 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/meta/1588230740/info 2023-07-15 03:10:53,770 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-15 03:10:53,771 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:10:53,771 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-15 03:10:53,775 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/meta/1588230740/rep_barrier 2023-07-15 03:10:53,775 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/meta/1588230740/rep_barrier 2023-07-15 03:10:53,777 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-15 03:10:53,777 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:10:53,778 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-15 03:10:53,779 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/meta/1588230740/table 2023-07-15 03:10:53,779 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/meta/1588230740/table 2023-07-15 03:10:53,780 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-15 03:10:53,783 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:10:53,786 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/meta/1588230740 2023-07-15 03:10:53,789 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/meta/1588230740 2023-07-15 03:10:53,793 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-15 03:10:53,805 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-15 03:10:53,811 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61002352, jitterRate=-0.09099411964416504}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-15 03:10:53,815 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-15 03:10:53,829 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689390653573 2023-07-15 03:10:53,850 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-15 03:10:53,851 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-15 03:10:53,852 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37439,1689390651159, state=OPEN 2023-07-15 03:10:53,856 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-15 03:10:53,856 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-15 03:10:53,870 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-15 03:10:53,871 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37439,1689390651159 in 506 msec 2023-07-15 03:10:53,891 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-15 03:10:53,891 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 733 msec 2023-07-15 03:10:53,902 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1540 sec 2023-07-15 03:10:53,902 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689390653902, completionTime=-1 2023-07-15 03:10:53,903 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-15 03:10:53,903 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-15 03:10:54,001 DEBUG [hconnection-0x2eee99d1-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:10:54,008 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44534, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:10:54,037 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-15 03:10:54,037 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689390714037 2023-07-15 03:10:54,038 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689390774038 2023-07-15 03:10:54,038 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 134 msec 2023-07-15 03:10:54,068 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45731,1689390649632-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:54,068 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45731,1689390649632-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:54,068 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45731,1689390649632-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:54,071 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:45731, period=300000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:54,072 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-15 03:10:54,080 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-15 03:10:54,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-15 03:10:54,090 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-15 03:10:54,105 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-15 03:10:54,108 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 03:10:54,115 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 03:10:54,159 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/hbase/namespace/c47f678a8bf1f978de39a7e77ccea25d 2023-07-15 03:10:54,163 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/hbase/namespace/c47f678a8bf1f978de39a7e77ccea25d empty. 2023-07-15 03:10:54,164 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/hbase/namespace/c47f678a8bf1f978de39a7e77ccea25d 2023-07-15 03:10:54,164 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-15 03:10:54,235 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-15 03:10:54,253 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => c47f678a8bf1f978de39a7e77ccea25d, NAME => 'hbase:namespace,,1689390654090.c47f678a8bf1f978de39a7e77ccea25d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp 2023-07-15 03:10:54,279 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689390654090.c47f678a8bf1f978de39a7e77ccea25d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:10:54,279 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing c47f678a8bf1f978de39a7e77ccea25d, disabling compactions & flushes 2023-07-15 03:10:54,279 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689390654090.c47f678a8bf1f978de39a7e77ccea25d. 2023-07-15 03:10:54,279 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689390654090.c47f678a8bf1f978de39a7e77ccea25d. 2023-07-15 03:10:54,279 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689390654090.c47f678a8bf1f978de39a7e77ccea25d. after waiting 0 ms 2023-07-15 03:10:54,279 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689390654090.c47f678a8bf1f978de39a7e77ccea25d. 2023-07-15 03:10:54,279 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689390654090.c47f678a8bf1f978de39a7e77ccea25d. 2023-07-15 03:10:54,279 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for c47f678a8bf1f978de39a7e77ccea25d: 2023-07-15 03:10:54,290 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 03:10:54,312 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689390654090.c47f678a8bf1f978de39a7e77ccea25d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689390654293"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390654293"}]},"ts":"1689390654293"} 2023-07-15 03:10:54,342 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-15 03:10:54,344 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 03:10:54,349 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390654344"}]},"ts":"1689390654344"} 2023-07-15 03:10:54,354 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-15 03:10:54,359 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 03:10:54,361 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 03:10:54,361 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 03:10:54,361 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 03:10:54,361 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 03:10:54,364 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c47f678a8bf1f978de39a7e77ccea25d, ASSIGN}] 2023-07-15 03:10:54,367 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c47f678a8bf1f978de39a7e77ccea25d, ASSIGN 2023-07-15 03:10:54,370 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=c47f678a8bf1f978de39a7e77ccea25d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43379,1689390651212; forceNewPlan=false, retain=false 2023-07-15 03:10:54,523 INFO [jenkins-hbase4:45731] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-15 03:10:54,527 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c47f678a8bf1f978de39a7e77ccea25d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:10:54,528 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689390654090.c47f678a8bf1f978de39a7e77ccea25d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689390654525"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390654525"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390654525"}]},"ts":"1689390654525"} 2023-07-15 03:10:54,532 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure c47f678a8bf1f978de39a7e77ccea25d, server=jenkins-hbase4.apache.org,43379,1689390651212}] 2023-07-15 03:10:54,689 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:10:54,690 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 03:10:54,693 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37500, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 03:10:54,700 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689390654090.c47f678a8bf1f978de39a7e77ccea25d. 2023-07-15 03:10:54,701 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c47f678a8bf1f978de39a7e77ccea25d, NAME => 'hbase:namespace,,1689390654090.c47f678a8bf1f978de39a7e77ccea25d.', STARTKEY => '', ENDKEY => ''} 2023-07-15 03:10:54,701 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689390654090.c47f678a8bf1f978de39a7e77ccea25d. service=AccessControlService 2023-07-15 03:10:54,702 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 03:10:54,702 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace c47f678a8bf1f978de39a7e77ccea25d 2023-07-15 03:10:54,703 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689390654090.c47f678a8bf1f978de39a7e77ccea25d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:10:54,703 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c47f678a8bf1f978de39a7e77ccea25d 2023-07-15 03:10:54,703 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c47f678a8bf1f978de39a7e77ccea25d 2023-07-15 03:10:54,706 INFO [StoreOpener-c47f678a8bf1f978de39a7e77ccea25d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region c47f678a8bf1f978de39a7e77ccea25d 2023-07-15 03:10:54,708 DEBUG [StoreOpener-c47f678a8bf1f978de39a7e77ccea25d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/namespace/c47f678a8bf1f978de39a7e77ccea25d/info 2023-07-15 03:10:54,708 DEBUG [StoreOpener-c47f678a8bf1f978de39a7e77ccea25d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/namespace/c47f678a8bf1f978de39a7e77ccea25d/info 2023-07-15 03:10:54,709 INFO [StoreOpener-c47f678a8bf1f978de39a7e77ccea25d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c47f678a8bf1f978de39a7e77ccea25d columnFamilyName info 2023-07-15 03:10:54,710 INFO [StoreOpener-c47f678a8bf1f978de39a7e77ccea25d-1] regionserver.HStore(310): Store=c47f678a8bf1f978de39a7e77ccea25d/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:10:54,712 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/namespace/c47f678a8bf1f978de39a7e77ccea25d 2023-07-15 03:10:54,713 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/namespace/c47f678a8bf1f978de39a7e77ccea25d 2023-07-15 03:10:54,718 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c47f678a8bf1f978de39a7e77ccea25d 2023-07-15 03:10:54,722 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/namespace/c47f678a8bf1f978de39a7e77ccea25d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 03:10:54,723 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c47f678a8bf1f978de39a7e77ccea25d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74244169, jitterRate=0.10632432997226715}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 03:10:54,723 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c47f678a8bf1f978de39a7e77ccea25d: 2023-07-15 03:10:54,725 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689390654090.c47f678a8bf1f978de39a7e77ccea25d., pid=6, masterSystemTime=1689390654689 2023-07-15 03:10:54,729 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689390654090.c47f678a8bf1f978de39a7e77ccea25d. 2023-07-15 03:10:54,730 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689390654090.c47f678a8bf1f978de39a7e77ccea25d. 2023-07-15 03:10:54,732 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c47f678a8bf1f978de39a7e77ccea25d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:10:54,732 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689390654090.c47f678a8bf1f978de39a7e77ccea25d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689390654731"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689390654731"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689390654731"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689390654731"}]},"ts":"1689390654731"} 2023-07-15 03:10:54,740 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-15 03:10:54,740 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure c47f678a8bf1f978de39a7e77ccea25d, server=jenkins-hbase4.apache.org,43379,1689390651212 in 205 msec 2023-07-15 03:10:54,743 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-15 03:10:54,744 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=c47f678a8bf1f978de39a7e77ccea25d, ASSIGN in 376 msec 2023-07-15 03:10:54,745 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 03:10:54,746 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390654745"}]},"ts":"1689390654745"} 2023-07-15 03:10:54,748 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-15 03:10:54,752 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 03:10:54,755 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 660 msec 2023-07-15 03:10:54,811 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-15 03:10:54,812 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-15 03:10:54,812 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 03:10:54,833 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:10:54,834 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37506, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:10:54,846 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-15 03:10:54,860 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-15 03:10:54,866 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 26 msec 2023-07-15 03:10:54,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-15 03:10:54,883 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-15 03:10:54,889 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 19 msec 2023-07-15 03:10:54,896 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-15 03:10:54,904 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-15 03:10:54,904 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.588sec 2023-07-15 03:10:54,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-15 03:10:54,910 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-15 03:10:54,910 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-15 03:10:54,912 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45731,1689390649632-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-15 03:10:54,912 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45731,1689390649632-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-15 03:10:54,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-15 03:10:54,937 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-15 03:10:54,940 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 03:10:54,941 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 03:10:54,944 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-15 03:10:54,944 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/hbase/acl/cd161ef32dc10f97040884020093175f 2023-07-15 03:10:54,945 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/hbase/acl/cd161ef32dc10f97040884020093175f empty. 2023-07-15 03:10:54,948 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/hbase/acl/cd161ef32dc10f97040884020093175f 2023-07-15 03:10:54,948 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-15 03:10:54,953 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-15 03:10:54,974 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-15 03:10:54,976 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => cd161ef32dc10f97040884020093175f, NAME => 'hbase:acl,,1689390654931.cd161ef32dc10f97040884020093175f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp 2023-07-15 03:10:54,985 DEBUG [Listener at localhost/40311] zookeeper.ReadOnlyZKClient(139): Connect 0x7ed1aec2 to 127.0.0.1:58749 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:10:54,996 DEBUG [Listener at localhost/40311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5af25722, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:10:55,017 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689390654931.cd161ef32dc10f97040884020093175f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:10:55,018 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing cd161ef32dc10f97040884020093175f, disabling compactions & flushes 2023-07-15 03:10:55,018 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689390654931.cd161ef32dc10f97040884020093175f. 2023-07-15 03:10:55,018 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689390654931.cd161ef32dc10f97040884020093175f. 2023-07-15 03:10:55,019 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689390654931.cd161ef32dc10f97040884020093175f. after waiting 0 ms 2023-07-15 03:10:55,019 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689390654931.cd161ef32dc10f97040884020093175f. 2023-07-15 03:10:55,019 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689390654931.cd161ef32dc10f97040884020093175f. 2023-07-15 03:10:55,019 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for cd161ef32dc10f97040884020093175f: 2023-07-15 03:10:55,023 DEBUG [hconnection-0x4f3276c6-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:10:55,025 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 03:10:55,026 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689390654931.cd161ef32dc10f97040884020093175f.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689390655026"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390655026"}]},"ts":"1689390655026"} 2023-07-15 03:10:55,029 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-15 03:10:55,032 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 03:10:55,032 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390655032"}]},"ts":"1689390655032"} 2023-07-15 03:10:55,035 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-15 03:10:55,040 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 03:10:55,040 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44542, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:10:55,041 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 03:10:55,041 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 03:10:55,041 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 03:10:55,041 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 03:10:55,042 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=cd161ef32dc10f97040884020093175f, ASSIGN}] 2023-07-15 03:10:55,044 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=cd161ef32dc10f97040884020093175f, ASSIGN 2023-07-15 03:10:55,044 INFO [Listener at localhost/40311] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,45731,1689390649632 2023-07-15 03:10:55,044 INFO [Listener at localhost/40311] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-15 03:10:55,044 INFO [Listener at localhost/40311] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/test.cache.data in system properties and HBase conf 2023-07-15 03:10:55,044 INFO [Listener at localhost/40311] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/hadoop.tmp.dir in system properties and HBase conf 2023-07-15 03:10:55,045 INFO [Listener at localhost/40311] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/hadoop.log.dir in system properties and HBase conf 2023-07-15 03:10:55,045 INFO [Listener at localhost/40311] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-15 03:10:55,045 INFO [Listener at localhost/40311] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-15 03:10:55,045 INFO [Listener at localhost/40311] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-15 03:10:55,045 INFO [Listener at localhost/40311] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-15 03:10:55,045 INFO [Listener at localhost/40311] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-15 03:10:55,045 INFO [Listener at localhost/40311] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-15 03:10:55,046 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=cd161ef32dc10f97040884020093175f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43379,1689390651212; forceNewPlan=false, retain=false 2023-07-15 03:10:55,046 INFO [Listener at localhost/40311] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-15 03:10:55,046 INFO [Listener at localhost/40311] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-15 03:10:55,046 INFO [Listener at localhost/40311] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-15 03:10:55,046 INFO [Listener at localhost/40311] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-15 03:10:55,046 INFO [Listener at localhost/40311] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-15 03:10:55,046 INFO [Listener at localhost/40311] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-15 03:10:55,046 INFO [Listener at localhost/40311] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/nfs.dump.dir in system properties and HBase conf 2023-07-15 03:10:55,046 INFO [Listener at localhost/40311] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/java.io.tmpdir in system properties and HBase conf 2023-07-15 03:10:55,047 INFO [Listener at localhost/40311] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-15 03:10:55,047 INFO [Listener at localhost/40311] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-15 03:10:55,047 INFO [Listener at localhost/40311] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-15 03:10:55,057 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-15 03:10:55,196 INFO [jenkins-hbase4:45731] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-15 03:10:55,197 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=cd161ef32dc10f97040884020093175f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:10:55,197 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689390654931.cd161ef32dc10f97040884020093175f.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689390655197"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390655197"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390655197"}]},"ts":"1689390655197"} 2023-07-15 03:10:55,202 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure cd161ef32dc10f97040884020093175f, server=jenkins-hbase4.apache.org,43379,1689390651212}] 2023-07-15 03:10:55,258 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-15 03:10:55,364 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689390654931.cd161ef32dc10f97040884020093175f. 2023-07-15 03:10:55,365 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cd161ef32dc10f97040884020093175f, NAME => 'hbase:acl,,1689390654931.cd161ef32dc10f97040884020093175f.', STARTKEY => '', ENDKEY => ''} 2023-07-15 03:10:55,365 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689390654931.cd161ef32dc10f97040884020093175f. service=AccessControlService 2023-07-15 03:10:55,365 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 03:10:55,366 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl cd161ef32dc10f97040884020093175f 2023-07-15 03:10:55,366 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689390654931.cd161ef32dc10f97040884020093175f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:10:55,366 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cd161ef32dc10f97040884020093175f 2023-07-15 03:10:55,366 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cd161ef32dc10f97040884020093175f 2023-07-15 03:10:55,372 INFO [StoreOpener-cd161ef32dc10f97040884020093175f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region cd161ef32dc10f97040884020093175f 2023-07-15 03:10:55,374 DEBUG [StoreOpener-cd161ef32dc10f97040884020093175f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/acl/cd161ef32dc10f97040884020093175f/l 2023-07-15 03:10:55,374 DEBUG [StoreOpener-cd161ef32dc10f97040884020093175f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/acl/cd161ef32dc10f97040884020093175f/l 2023-07-15 03:10:55,375 INFO [StoreOpener-cd161ef32dc10f97040884020093175f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cd161ef32dc10f97040884020093175f columnFamilyName l 2023-07-15 03:10:55,377 INFO [StoreOpener-cd161ef32dc10f97040884020093175f-1] regionserver.HStore(310): Store=cd161ef32dc10f97040884020093175f/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:10:55,381 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/acl/cd161ef32dc10f97040884020093175f 2023-07-15 03:10:55,382 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/acl/cd161ef32dc10f97040884020093175f 2023-07-15 03:10:55,389 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cd161ef32dc10f97040884020093175f 2023-07-15 03:10:55,392 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/acl/cd161ef32dc10f97040884020093175f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 03:10:55,393 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cd161ef32dc10f97040884020093175f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69356123, jitterRate=0.03348676860332489}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 03:10:55,393 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cd161ef32dc10f97040884020093175f: 2023-07-15 03:10:55,394 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689390654931.cd161ef32dc10f97040884020093175f., pid=11, masterSystemTime=1689390655358 2023-07-15 03:10:55,399 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689390654931.cd161ef32dc10f97040884020093175f. 2023-07-15 03:10:55,399 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689390654931.cd161ef32dc10f97040884020093175f. 2023-07-15 03:10:55,399 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=cd161ef32dc10f97040884020093175f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:10:55,400 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689390654931.cd161ef32dc10f97040884020093175f.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689390655399"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689390655399"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689390655399"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689390655399"}]},"ts":"1689390655399"} 2023-07-15 03:10:55,407 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-15 03:10:55,407 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure cd161ef32dc10f97040884020093175f, server=jenkins-hbase4.apache.org,43379,1689390651212 in 201 msec 2023-07-15 03:10:55,411 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-15 03:10:55,411 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=cd161ef32dc10f97040884020093175f, ASSIGN in 365 msec 2023-07-15 03:10:55,412 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 03:10:55,412 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390655412"}]},"ts":"1689390655412"} 2023-07-15 03:10:55,415 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-15 03:10:55,419 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 03:10:55,423 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 484 msec 2023-07-15 03:10:55,558 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-15 03:10:55,558 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-15 03:10:55,587 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-15 03:10:56,541 WARN [Thread-384] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 03:10:56,928 INFO [Thread-384] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 03:10:56,935 INFO [Thread-384] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_33361_jobhistory____.bphy89/webapp 2023-07-15 03:10:57,129 INFO [Thread-384] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-15 03:10:57,129 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-15 03:10:57,129 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-15 03:10:57,133 INFO [Thread-384] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-15 03:10:57,226 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 03:10:57,603 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 03:10:58,168 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-15 03:10:58,257 INFO [Thread-384] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:33361 2023-07-15 03:10:59,308 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 03:10:59,396 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-15 03:10:59,599 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-15 03:10:59,601 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-15 03:10:59,610 WARN [Listener at jenkins-hbase4.apache.org/38483] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 03:10:59,715 WARN [Listener at jenkins-hbase4.apache.org/38483] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-15 03:10:59,715 INFO [Listener at jenkins-hbase4.apache.org/38483] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 03:10:59,742 INFO [Listener at jenkins-hbase4.apache.org/38483] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_46665_cluster____.n786pb/webapp 2023-07-15 03:10:59,816 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:10:59,817 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-15 03:10:59,817 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:10:59,817 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-15 03:10:59,818 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-15 03:10:59,818 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-15 03:10:59,818 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:10:59,818 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-15 03:10:59,818 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-15 03:10:59,818 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-15 03:10:59,849 INFO [Listener at jenkins-hbase4.apache.org/38483] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-15 03:10:59,849 INFO [Listener at jenkins-hbase4.apache.org/38483] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-15 03:10:59,849 INFO [Listener at jenkins-hbase4.apache.org/38483] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-15 03:10:59,850 INFO [Listener at jenkins-hbase4.apache.org/38483] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-15 03:10:59,863 INFO [Listener at jenkins-hbase4.apache.org/38483] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 03:11:00,078 INFO [Listener at jenkins-hbase4.apache.org/38483] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 03:11:00,198 INFO [Listener at jenkins-hbase4.apache.org/38483] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 03:11:00,206 INFO [Listener at jenkins-hbase4.apache.org/38483] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46665 2023-07-15 03:11:00,800 WARN [Listener at jenkins-hbase4.apache.org/37599] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 03:11:00,831 WARN [Listener at jenkins-hbase4.apache.org/37599] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-15 03:11:00,832 INFO [Listener at jenkins-hbase4.apache.org/37599] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 03:11:00,838 INFO [Listener at jenkins-hbase4.apache.org/37599] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_46807_node____.w6hxdx/webapp 2023-07-15 03:11:00,894 INFO [Listener at jenkins-hbase4.apache.org/37599] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-15 03:11:00,894 INFO [Listener at jenkins-hbase4.apache.org/37599] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-15 03:11:00,894 INFO [Listener at jenkins-hbase4.apache.org/37599] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-15 03:11:00,894 INFO [Listener at jenkins-hbase4.apache.org/37599] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-15 03:11:00,904 INFO [Listener at jenkins-hbase4.apache.org/37599] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 03:11:00,934 INFO [Listener at jenkins-hbase4.apache.org/37599] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 03:11:01,031 INFO [Listener at jenkins-hbase4.apache.org/37599] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 03:11:01,047 INFO [Listener at jenkins-hbase4.apache.org/37599] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46807 2023-07-15 03:11:01,364 WARN [Listener at jenkins-hbase4.apache.org/35095] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 03:11:01,370 WARN [Listener at jenkins-hbase4.apache.org/35095] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-15 03:11:01,370 INFO [Listener at jenkins-hbase4.apache.org/35095] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 03:11:01,378 INFO [Listener at jenkins-hbase4.apache.org/35095] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_35089_node____.jk8mk3/webapp 2023-07-15 03:11:01,438 INFO [Listener at jenkins-hbase4.apache.org/35095] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-15 03:11:01,438 INFO [Listener at jenkins-hbase4.apache.org/35095] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-15 03:11:01,438 INFO [Listener at jenkins-hbase4.apache.org/35095] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-15 03:11:01,439 INFO [Listener at jenkins-hbase4.apache.org/35095] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-15 03:11:01,449 INFO [Listener at jenkins-hbase4.apache.org/35095] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 03:11:01,469 INFO [Listener at jenkins-hbase4.apache.org/35095] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 03:11:01,548 INFO [Listener at jenkins-hbase4.apache.org/35095] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 03:11:01,563 INFO [Listener at jenkins-hbase4.apache.org/35095] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35089 2023-07-15 03:11:01,590 INFO [Listener at jenkins-hbase4.apache.org/35095] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-15 03:11:01,592 INFO [Listener at jenkins-hbase4.apache.org/35095] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 03:11:01,662 INFO [Listener at jenkins-hbase4.apache.org/35095] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=702, OpenFileDescriptor=896, MaxFileDescriptor=60000, SystemLoadAverage=252, ProcessCount=174, AvailableMemoryMB=4301 2023-07-15 03:11:01,662 WARN [Listener at jenkins-hbase4.apache.org/35095] hbase.ResourceChecker(130): Thread=702 is superior to 500 2023-07-15 03:11:01,681 DEBUG [Listener at jenkins-hbase4.apache.org/35095] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-15 03:11:01,687 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48852, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-15 03:11:01,696 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-15 03:11:01,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-15 03:11:01,703 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 03:11:01,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-15 03:11:01,707 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 03:11:01,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-15 03:11:01,721 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportWithTargetName/144f7e7eaa33a2d03c4bfb7c41ac453b 2023-07-15 03:11:01,721 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportWithTargetName/aaa09a609b25909839ebda67e942aea7 2023-07-15 03:11:01,728 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportWithTargetName/144f7e7eaa33a2d03c4bfb7c41ac453b empty. 2023-07-15 03:11:01,729 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportWithTargetName/aaa09a609b25909839ebda67e942aea7 empty. 2023-07-15 03:11:01,731 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportWithTargetName/aaa09a609b25909839ebda67e942aea7 2023-07-15 03:11:01,733 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportWithTargetName/144f7e7eaa33a2d03c4bfb7c41ac453b 2023-07-15 03:11:01,733 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-15 03:11:01,787 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-15 03:11:01,789 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 144f7e7eaa33a2d03c4bfb7c41ac453b, NAME => 'testtb-testExportWithTargetName,,1689390661695.144f7e7eaa33a2d03c4bfb7c41ac453b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp 2023-07-15 03:11:01,790 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => aaa09a609b25909839ebda67e942aea7, NAME => 'testtb-testExportWithTargetName,1,1689390661695.aaa09a609b25909839ebda67e942aea7.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp 2023-07-15 03:11:01,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-15 03:11:01,836 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689390661695.144f7e7eaa33a2d03c4bfb7c41ac453b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:11:01,837 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 144f7e7eaa33a2d03c4bfb7c41ac453b, disabling compactions & flushes 2023-07-15 03:11:01,837 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689390661695.144f7e7eaa33a2d03c4bfb7c41ac453b. 2023-07-15 03:11:01,837 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689390661695.144f7e7eaa33a2d03c4bfb7c41ac453b. 2023-07-15 03:11:01,837 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689390661695.144f7e7eaa33a2d03c4bfb7c41ac453b. after waiting 0 ms 2023-07-15 03:11:01,837 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689390661695.aaa09a609b25909839ebda67e942aea7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:11:01,837 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689390661695.144f7e7eaa33a2d03c4bfb7c41ac453b. 2023-07-15 03:11:01,837 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing aaa09a609b25909839ebda67e942aea7, disabling compactions & flushes 2023-07-15 03:11:01,837 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689390661695.144f7e7eaa33a2d03c4bfb7c41ac453b. 2023-07-15 03:11:01,837 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689390661695.aaa09a609b25909839ebda67e942aea7. 2023-07-15 03:11:01,837 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 144f7e7eaa33a2d03c4bfb7c41ac453b: 2023-07-15 03:11:01,837 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689390661695.aaa09a609b25909839ebda67e942aea7. 2023-07-15 03:11:01,837 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689390661695.aaa09a609b25909839ebda67e942aea7. after waiting 0 ms 2023-07-15 03:11:01,838 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689390661695.aaa09a609b25909839ebda67e942aea7. 2023-07-15 03:11:01,838 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689390661695.aaa09a609b25909839ebda67e942aea7. 2023-07-15 03:11:01,838 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for aaa09a609b25909839ebda67e942aea7: 2023-07-15 03:11:01,842 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 03:11:01,843 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689390661695.144f7e7eaa33a2d03c4bfb7c41ac453b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689390661843"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390661843"}]},"ts":"1689390661843"} 2023-07-15 03:11:01,844 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689390661695.aaa09a609b25909839ebda67e942aea7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689390661843"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390661843"}]},"ts":"1689390661843"} 2023-07-15 03:11:01,894 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 03:11:01,896 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 03:11:01,897 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390661896"}]},"ts":"1689390661896"} 2023-07-15 03:11:01,900 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-15 03:11:01,906 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 03:11:01,908 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 03:11:01,909 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 03:11:01,909 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 03:11:01,909 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 03:11:01,909 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=144f7e7eaa33a2d03c4bfb7c41ac453b, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=aaa09a609b25909839ebda67e942aea7, ASSIGN}] 2023-07-15 03:11:01,913 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=aaa09a609b25909839ebda67e942aea7, ASSIGN 2023-07-15 03:11:01,913 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=144f7e7eaa33a2d03c4bfb7c41ac453b, ASSIGN 2023-07-15 03:11:01,914 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=aaa09a609b25909839ebda67e942aea7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37439,1689390651159; forceNewPlan=false, retain=false 2023-07-15 03:11:01,914 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=144f7e7eaa33a2d03c4bfb7c41ac453b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43379,1689390651212; forceNewPlan=false, retain=false 2023-07-15 03:11:02,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-15 03:11:02,065 INFO [jenkins-hbase4:45731] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 03:11:02,068 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=aaa09a609b25909839ebda67e942aea7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:02,068 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=144f7e7eaa33a2d03c4bfb7c41ac453b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:02,068 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689390661695.aaa09a609b25909839ebda67e942aea7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689390662067"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390662067"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390662067"}]},"ts":"1689390662067"} 2023-07-15 03:11:02,068 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689390661695.144f7e7eaa33a2d03c4bfb7c41ac453b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689390662067"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390662067"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390662067"}]},"ts":"1689390662067"} 2023-07-15 03:11:02,071 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure aaa09a609b25909839ebda67e942aea7, server=jenkins-hbase4.apache.org,37439,1689390651159}] 2023-07-15 03:11:02,073 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 144f7e7eaa33a2d03c4bfb7c41ac453b, server=jenkins-hbase4.apache.org,43379,1689390651212}] 2023-07-15 03:11:02,232 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689390661695.144f7e7eaa33a2d03c4bfb7c41ac453b. 2023-07-15 03:11:02,232 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689390661695.aaa09a609b25909839ebda67e942aea7. 2023-07-15 03:11:02,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 144f7e7eaa33a2d03c4bfb7c41ac453b, NAME => 'testtb-testExportWithTargetName,,1689390661695.144f7e7eaa33a2d03c4bfb7c41ac453b.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 03:11:02,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => aaa09a609b25909839ebda67e942aea7, NAME => 'testtb-testExportWithTargetName,1,1689390661695.aaa09a609b25909839ebda67e942aea7.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 03:11:02,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689390661695.144f7e7eaa33a2d03c4bfb7c41ac453b. service=AccessControlService 2023-07-15 03:11:02,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689390661695.aaa09a609b25909839ebda67e942aea7. service=AccessControlService 2023-07-15 03:11:02,233 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 03:11:02,233 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 03:11:02,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 144f7e7eaa33a2d03c4bfb7c41ac453b 2023-07-15 03:11:02,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689390661695.144f7e7eaa33a2d03c4bfb7c41ac453b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:11:02,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName aaa09a609b25909839ebda67e942aea7 2023-07-15 03:11:02,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 144f7e7eaa33a2d03c4bfb7c41ac453b 2023-07-15 03:11:02,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689390661695.aaa09a609b25909839ebda67e942aea7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:11:02,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 144f7e7eaa33a2d03c4bfb7c41ac453b 2023-07-15 03:11:02,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for aaa09a609b25909839ebda67e942aea7 2023-07-15 03:11:02,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for aaa09a609b25909839ebda67e942aea7 2023-07-15 03:11:02,237 INFO [StoreOpener-aaa09a609b25909839ebda67e942aea7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region aaa09a609b25909839ebda67e942aea7 2023-07-15 03:11:02,237 INFO [StoreOpener-144f7e7eaa33a2d03c4bfb7c41ac453b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 144f7e7eaa33a2d03c4bfb7c41ac453b 2023-07-15 03:11:02,239 DEBUG [StoreOpener-aaa09a609b25909839ebda67e942aea7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportWithTargetName/aaa09a609b25909839ebda67e942aea7/cf 2023-07-15 03:11:02,239 DEBUG [StoreOpener-aaa09a609b25909839ebda67e942aea7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportWithTargetName/aaa09a609b25909839ebda67e942aea7/cf 2023-07-15 03:11:02,239 DEBUG [StoreOpener-144f7e7eaa33a2d03c4bfb7c41ac453b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportWithTargetName/144f7e7eaa33a2d03c4bfb7c41ac453b/cf 2023-07-15 03:11:02,239 DEBUG [StoreOpener-144f7e7eaa33a2d03c4bfb7c41ac453b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportWithTargetName/144f7e7eaa33a2d03c4bfb7c41ac453b/cf 2023-07-15 03:11:02,243 INFO [StoreOpener-144f7e7eaa33a2d03c4bfb7c41ac453b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 144f7e7eaa33a2d03c4bfb7c41ac453b columnFamilyName cf 2023-07-15 03:11:02,243 INFO [StoreOpener-aaa09a609b25909839ebda67e942aea7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aaa09a609b25909839ebda67e942aea7 columnFamilyName cf 2023-07-15 03:11:02,245 INFO [StoreOpener-144f7e7eaa33a2d03c4bfb7c41ac453b-1] regionserver.HStore(310): Store=144f7e7eaa33a2d03c4bfb7c41ac453b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:11:02,245 INFO [StoreOpener-aaa09a609b25909839ebda67e942aea7-1] regionserver.HStore(310): Store=aaa09a609b25909839ebda67e942aea7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:11:02,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportWithTargetName/aaa09a609b25909839ebda67e942aea7 2023-07-15 03:11:02,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportWithTargetName/144f7e7eaa33a2d03c4bfb7c41ac453b 2023-07-15 03:11:02,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportWithTargetName/aaa09a609b25909839ebda67e942aea7 2023-07-15 03:11:02,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportWithTargetName/144f7e7eaa33a2d03c4bfb7c41ac453b 2023-07-15 03:11:02,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 144f7e7eaa33a2d03c4bfb7c41ac453b 2023-07-15 03:11:02,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for aaa09a609b25909839ebda67e942aea7 2023-07-15 03:11:02,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportWithTargetName/144f7e7eaa33a2d03c4bfb7c41ac453b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 03:11:02,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportWithTargetName/aaa09a609b25909839ebda67e942aea7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 03:11:02,267 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 144f7e7eaa33a2d03c4bfb7c41ac453b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61694494, jitterRate=-0.08068040013313293}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 03:11:02,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 144f7e7eaa33a2d03c4bfb7c41ac453b: 2023-07-15 03:11:02,268 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened aaa09a609b25909839ebda67e942aea7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62460818, jitterRate=-0.06926128268241882}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 03:11:02,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for aaa09a609b25909839ebda67e942aea7: 2023-07-15 03:11:02,269 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689390661695.144f7e7eaa33a2d03c4bfb7c41ac453b., pid=16, masterSystemTime=1689390662226 2023-07-15 03:11:02,269 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689390661695.aaa09a609b25909839ebda67e942aea7., pid=15, masterSystemTime=1689390662225 2023-07-15 03:11:02,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689390661695.144f7e7eaa33a2d03c4bfb7c41ac453b. 2023-07-15 03:11:02,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689390661695.144f7e7eaa33a2d03c4bfb7c41ac453b. 2023-07-15 03:11:02,272 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=144f7e7eaa33a2d03c4bfb7c41ac453b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:02,273 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689390661695.144f7e7eaa33a2d03c4bfb7c41ac453b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689390662272"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689390662272"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689390662272"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689390662272"}]},"ts":"1689390662272"} 2023-07-15 03:11:02,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689390661695.aaa09a609b25909839ebda67e942aea7. 2023-07-15 03:11:02,273 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689390661695.aaa09a609b25909839ebda67e942aea7. 2023-07-15 03:11:02,273 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=aaa09a609b25909839ebda67e942aea7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:02,276 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689390661695.aaa09a609b25909839ebda67e942aea7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689390662273"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689390662273"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689390662273"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689390662273"}]},"ts":"1689390662273"} 2023-07-15 03:11:02,281 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-15 03:11:02,282 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 144f7e7eaa33a2d03c4bfb7c41ac453b, server=jenkins-hbase4.apache.org,43379,1689390651212 in 205 msec 2023-07-15 03:11:02,284 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-15 03:11:02,285 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure aaa09a609b25909839ebda67e942aea7, server=jenkins-hbase4.apache.org,37439,1689390651159 in 209 msec 2023-07-15 03:11:02,285 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=144f7e7eaa33a2d03c4bfb7c41ac453b, ASSIGN in 373 msec 2023-07-15 03:11:02,288 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=12 2023-07-15 03:11:02,288 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=aaa09a609b25909839ebda67e942aea7, ASSIGN in 376 msec 2023-07-15 03:11:02,289 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 03:11:02,289 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390662289"}]},"ts":"1689390662289"} 2023-07-15 03:11:02,291 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-15 03:11:02,293 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 03:11:02,298 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-15 03:11:02,309 DEBUG [hconnection-0x2aa68faf-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:11:02,312 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54680, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=ClientService 2023-07-15 03:11:02,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-15 03:11:02,323 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43379] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-15 03:11:02,355 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-15 03:11:02,355 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-15 03:11:02,355 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-15 03:11:02,355 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 03:11:02,355 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-15 03:11:02,378 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 03:11:02,378 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 03:11:02,379 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-15 03:11:02,380 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-15 03:11:02,381 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-15 03:11:02,384 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 682 msec 2023-07-15 03:11:02,385 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-15 03:11:02,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-15 03:11:02,817 INFO [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-15 03:11:02,821 DEBUG [Listener at jenkins-hbase4.apache.org/35095] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-15 03:11:02,822 DEBUG [Listener at jenkins-hbase4.apache.org/35095] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689390661695.144f7e7eaa33a2d03c4bfb7c41ac453b. 2023-07-15 03:11:02,825 INFO [Listener at jenkins-hbase4.apache.org/35095] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 03:11:02,848 DEBUG [hconnection-0x4f3276c6-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:11:02,852 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47728, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:11:02,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 03:11:02,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689390662871 (current time:1689390662871). 2023-07-15 03:11:02,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 03:11:02,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(139): Connect 0x7654adf0 to 127.0.0.1:58749 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:11:02,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46c1efc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:11:02,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:11:02,881 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54686, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:11:02,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7654adf0 to 127.0.0.1:58749 2023-07-15 03:11:02,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:11:02,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(139): Connect 0x59d03f06 to 127.0.0.1:58749 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:11:02,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69df6c27, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:11:02,892 DEBUG [hconnection-0x3d79f5ce-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:11:02,893 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54698, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:11:02,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:11:02,899 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47742, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:11:02,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x59d03f06 to 127.0.0.1:58749 2023-07-15 03:11:02,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:11:02,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-15 03:11:02,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 03:11:02,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 03:11:02,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 03:11:02,943 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 03:11:02,944 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689391262944 2023-07-15 03:11:02,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 03:11:02,944 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-15 03:11:02,946 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 03:11:02,947 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 03:11:02,949 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 12 msec 2023-07-15 03:11:02,950 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 03:11:02,952 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689391262952 2023-07-15 03:11:02,952 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 03:11:02,952 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 03:11:02,974 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:02,974 INFO [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-15 03:11:02,975 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:02,975 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-15 03:11:02,975 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-15 03:11:02,976 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:02,976 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:02,982 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:02,982 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:02,982 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:02,982 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:02,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:02,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:02,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:02,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:02,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:02,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:02,983 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:02,983 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:02,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:02,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:02,984 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:02,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:02,984 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 03:11:02,984 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:02,984 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:02,984 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:02,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-15 03:11:02,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-15 03:11:02,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:02,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-15 03:11:02,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:02,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:02,986 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 03:11:02,986 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 03:11:02,986 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 03:11:02,989 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:02,989 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:02,989 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:02,989 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 03:11:02,989 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:02,989 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 03:11:02,990 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 03:11:02,990 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 03:11:02,990 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:02,990 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:02,991 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 03:11:02,991 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 03:11:02,992 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-15 03:11:02,990 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-15 03:11:02,992 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37439,1689390651159' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-15 03:11:02,992 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-15 03:11:02,992 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40245,1689390651089' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-15 03:11:02,992 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43379,1689390651212' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-15 03:11:02,994 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:02,994 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:02,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:02,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:02,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:02,995 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:02,995 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:02,995 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:02,995 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:02,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:02,995 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:11:02,995 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:02,995 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:11:02,995 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:02,995 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:11:02,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:02,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:02,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:02,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:02,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:02,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:02,998 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37439,1689390651159' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-15 03:11:02,998 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@529506ef[Count = 1] remaining members to acquire global barrier 2023-07-15 03:11:02,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:02,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:02,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:02,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:02,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:02,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:02,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:03,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:03,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:03,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:03,000 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43379,1689390651212' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-15 03:11:03,001 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@529506ef[Count = 0] remaining members to acquire global barrier 2023-07-15 03:11:03,001 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-15 03:11:03,001 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,002 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,002 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,002 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,003 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 03:11:03,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,003 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-15 03:11:03,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,003 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40245,1689390651089' in zk 2023-07-15 03:11:03,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,003 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:03,003 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 03:11:03,003 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 03:11:03,003 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:03,004 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 03:11:03,007 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:11:03,007 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:11:03,008 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 03:11:03,008 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689390661695.aaa09a609b25909839ebda67e942aea7. 2023-07-15 03:11:03,008 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:11:03,007 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689390651212)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689390661695.144f7e7eaa33a2d03c4bfb7c41ac453b. 2023-07-15 03:11:03,008 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:03,008 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:11:03,008 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-15 03:11:03,009 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689390661695.aaa09a609b25909839ebda67e942aea7. started... 2023-07-15 03:11:03,009 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689390651212)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689390661695.144f7e7eaa33a2d03c4bfb7c41ac453b. started... 2023-07-15 03:11:03,011 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for aaa09a609b25909839ebda67e942aea7: 2023-07-15 03:11:03,011 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689390651212)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 144f7e7eaa33a2d03c4bfb7c41ac453b: 2023-07-15 03:11:03,013 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689390651212)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689390661695.144f7e7eaa33a2d03c4bfb7c41ac453b.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,013 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689390661695.aaa09a609b25909839ebda67e942aea7.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,018 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:11:03,018 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689390651212)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:11:03,023 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 03:11:03,023 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689390651212)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 03:11:03,059 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:11:03,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 03:11:03,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-15 03:11:03,077 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 03:11:03,080 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689390661695.aaa09a609b25909839ebda67e942aea7. completed. 2023-07-15 03:11:03,080 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689390651212)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689390661695.144f7e7eaa33a2d03c4bfb7c41ac453b. completed. 2023-07-15 03:11:03,080 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689390661695.aaa09a609b25909839ebda67e942aea7. 2023-07-15 03:11:03,080 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689390651212)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689390661695.144f7e7eaa33a2d03c4bfb7c41ac453b. 2023-07-15 03:11:03,080 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:11:03,080 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:11:03,080 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:11:03,081 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:11:03,081 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:03,081 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:03,081 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-15 03:11:03,081 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-15 03:11:03,081 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43379,1689390651212' in zk 2023-07-15 03:11:03,081 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37439,1689390651159' in zk 2023-07-15 03:11:03,088 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 03:11:03,088 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:03,088 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:03,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:03,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:03,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:03,088 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-15 03:11:03,089 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 03:11:03,089 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:03,090 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:03,090 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-15 03:11:03,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:03,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:03,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:03,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:03,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:03,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:03,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:03,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:03,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:03,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,37439,1689390651159': 2023-07-15 03:11:03,095 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37439,1689390651159' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-15 03:11:03,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:03,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:03,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:03,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:03,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:03,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:03,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:03,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:03,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:03,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:03,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:03,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:03,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43379,1689390651212': 2023-07-15 03:11:03,100 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43379,1689390651212' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-15 03:11:03,100 INFO [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-15 03:11:03,100 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 03:11:03,100 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 03:11:03,100 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,100 INFO [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 03:11:03,103 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,103 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,103 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,103 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:03,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,103 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:03,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:03,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:03,103 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,104 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:03,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:03,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:03,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:03,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:03,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:03,104 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:03,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:03,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:03,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,105 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:03,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:03,105 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:03,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:03,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:03,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:03,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:03,108 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:03,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,108 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:03,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:03,109 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:03,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:03,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:03,122 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:03,122 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:03,122 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:03,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:03,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:03,122 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:03,122 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:03,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:03,122 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:03,122 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:03,123 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:03,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:03,123 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:03,122 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:03,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:03,124 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:03,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:03,123 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-15 03:11:03,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:03,123 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:03,124 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,124 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,124 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 03:11:03,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:03,124 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:03,124 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,125 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:03,125 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:03,125 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,125 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:03,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:03,125 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-15 03:11:03,147 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,150 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,204 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,277 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:11:03,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 03:11:03,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-15 03:11:03,281 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-15 03:11:03,281 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,281 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 03:11:03,282 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:03,282 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689390662944Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689390663147 (+203 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689390663147Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689390663148 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689390663164 (+16 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689390663192 (+28 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689390663281 (+89 ms) 2023-07-15 03:11:03,284 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 03:11:03,288 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 339 msec 2023-07-15 03:11:03,581 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:11:03,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 03:11:03,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 03:11:03,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43379] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689390661695.144f7e7eaa33a2d03c4bfb7c41ac453b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 03:11:03,601 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37439] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689390661695.aaa09a609b25909839ebda67e942aea7. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 03:11:03,606 DEBUG [Listener at jenkins-hbase4.apache.org/35095] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-15 03:11:03,606 DEBUG [Listener at jenkins-hbase4.apache.org/35095] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689390661695.144f7e7eaa33a2d03c4bfb7c41ac453b. 2023-07-15 03:11:03,607 INFO [Listener at jenkins-hbase4.apache.org/35095] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 03:11:03,622 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 03:11:03,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689390663622 (current time:1689390663622). 2023-07-15 03:11:03,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 03:11:03,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(139): Connect 0x6e9f4d2e to 127.0.0.1:58749 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:11:03,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ca725cd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:11:03,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:11:03,665 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54702, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:11:03,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6e9f4d2e to 127.0.0.1:58749 2023-07-15 03:11:03,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:11:03,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(139): Connect 0x46f248de to 127.0.0.1:58749 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:11:03,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52909b13, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:11:03,697 DEBUG [hconnection-0x377c55c1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:11:03,701 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54716, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:11:03,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:11:03,709 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47750, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:11:03,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x46f248de to 127.0.0.1:58749 2023-07-15 03:11:03,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:11:03,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-15 03:11:03,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 03:11:03,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 03:11:03,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 03:11:03,717 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 03:11:03,718 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689391263718 2023-07-15 03:11:03,718 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-15 03:11:03,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 03:11:03,721 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 03:11:03,721 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 03:11:03,722 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 03:11:03,722 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 03:11:03,723 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 8 msec 2023-07-15 03:11:03,724 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 03:11:03,725 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689391263725 2023-07-15 03:11:03,747 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-15 03:11:03,747 INFO [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-15 03:11:03,747 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:03,748 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-15 03:11:03,748 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-15 03:11:03,749 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,749 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,751 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:03,751 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:03,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:03,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:03,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:03,751 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:03,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:03,752 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:03,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,752 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:03,753 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,753 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:03,753 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 03:11:03,753 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-15 03:11:03,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-15 03:11:03,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,753 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 03:11:03,753 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 03:11:03,754 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-15 03:11:03,754 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 03:11:03,754 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-15 03:11:03,754 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:03,754 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 03:11:03,755 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 03:11:03,755 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-15 03:11:03,755 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:03,755 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43379,1689390651212' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-15 03:11:03,756 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 03:11:03,756 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:03,756 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-15 03:11:03,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:03,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:03,756 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37439,1689390651159' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-15 03:11:03,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,758 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:03,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:03,758 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,758 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:03,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:03,760 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,760 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:11:03,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:03,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-15 03:11:03,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,760 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 03:11:03,761 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-15 03:11:03,761 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 03:11:03,761 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:03,762 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 03:11:03,762 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-15 03:11:03,762 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40245,1689390651089' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-15 03:11:03,762 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:03,762 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:03,762 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,762 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:11:03,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 03:11:03,764 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:03,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:03,765 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,765 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:11:03,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:03,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:03,766 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43379,1689390651212' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-15 03:11:03,766 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6fdffbc4[Count = 1] remaining members to acquire global barrier 2023-07-15 03:11:03,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:03,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:03,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:03,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:03,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:03,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 03:11:03,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:03,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:03,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:03,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:03,768 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37439,1689390651159' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-15 03:11:03,769 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6fdffbc4[Count = 0] remaining members to acquire global barrier 2023-07-15 03:11:03,769 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-15 03:11:03,769 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,773 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,773 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,773 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,773 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 03:11:03,773 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 03:11:03,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 03:11:03,773 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:11:03,773 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689390651212)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689390661695.144f7e7eaa33a2d03c4bfb7c41ac453b. 2023-07-15 03:11:03,773 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 03:11:03,773 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689390661695.aaa09a609b25909839ebda67e942aea7. 2023-07-15 03:11:03,773 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:03,774 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689390661695.aaa09a609b25909839ebda67e942aea7. started... 2023-07-15 03:11:03,773 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-15 03:11:03,773 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689390651212)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689390661695.144f7e7eaa33a2d03c4bfb7c41ac453b. started... 2023-07-15 03:11:03,773 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:11:03,774 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:11:03,774 INFO [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] regionserver.HRegion(2745): Flushing aaa09a609b25909839ebda67e942aea7 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-15 03:11:03,773 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:11:03,774 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:03,774 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 03:11:03,774 INFO [rs(jenkins-hbase4.apache.org,43379,1689390651212)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 144f7e7eaa33a2d03c4bfb7c41ac453b 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-15 03:11:03,774 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40245,1689390651089' in zk 2023-07-15 03:11:03,777 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 03:11:03,777 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:03,777 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-15 03:11:03,822 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:11:03,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 03:11:03,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-15 03:11:03,824 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 03:11:03,936 INFO [rs(jenkins-hbase4.apache.org,43379,1689390651212)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307158ba6ed02a91a4a8ea80872c85fafb11b to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307158ba6ed02a91a4a8ea80872c85fafb11b 2023-07-15 03:11:03,936 INFO [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071510475ff66ca54c37b0c8149dc16fc085 to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023071510475ff66ca54c37b0c8149dc16fc085 2023-07-15 03:11:03,974 INFO [rs(jenkins-hbase4.apache.org,43379,1689390651212)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportWithTargetName/144f7e7eaa33a2d03c4bfb7c41ac453b/.tmp/cf/2f5136ed0aa043a08e0e90153a03e260 2023-07-15 03:11:03,976 INFO [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportWithTargetName/aaa09a609b25909839ebda67e942aea7/.tmp/cf/181a1800f10f46d88e125a73cc94c66b 2023-07-15 03:11:03,987 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689390651212)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportWithTargetName/144f7e7eaa33a2d03c4bfb7c41ac453b/.tmp/cf/2f5136ed0aa043a08e0e90153a03e260 as hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportWithTargetName/144f7e7eaa33a2d03c4bfb7c41ac453b/cf/2f5136ed0aa043a08e0e90153a03e260 2023-07-15 03:11:03,987 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportWithTargetName/aaa09a609b25909839ebda67e942aea7/.tmp/cf/181a1800f10f46d88e125a73cc94c66b as hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportWithTargetName/aaa09a609b25909839ebda67e942aea7/cf/181a1800f10f46d88e125a73cc94c66b 2023-07-15 03:11:03,995 INFO [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportWithTargetName/aaa09a609b25909839ebda67e942aea7/cf/181a1800f10f46d88e125a73cc94c66b, entries=45, sequenceid=6, filesize=12.5 K 2023-07-15 03:11:03,996 INFO [rs(jenkins-hbase4.apache.org,43379,1689390651212)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportWithTargetName/144f7e7eaa33a2d03c4bfb7c41ac453b/cf/2f5136ed0aa043a08e0e90153a03e260, entries=5, sequenceid=6, filesize=5.7 K 2023-07-15 03:11:04,000 INFO [rs(jenkins-hbase4.apache.org,43379,1689390651212)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 144f7e7eaa33a2d03c4bfb7c41ac453b in 226ms, sequenceid=6, compaction requested=false 2023-07-15 03:11:04,000 INFO [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for aaa09a609b25909839ebda67e942aea7 in 226ms, sequenceid=6, compaction requested=false 2023-07-15 03:11:04,000 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689390651212)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-15 03:11:04,000 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-15 03:11:04,003 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for aaa09a609b25909839ebda67e942aea7: 2023-07-15 03:11:04,003 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689390651212)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 144f7e7eaa33a2d03c4bfb7c41ac453b: 2023-07-15 03:11:04,004 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689390661695.aaa09a609b25909839ebda67e942aea7.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-15 03:11:04,004 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689390651212)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689390661695.144f7e7eaa33a2d03c4bfb7c41ac453b.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-15 03:11:04,004 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:11:04,004 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689390651212)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:11:04,004 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportWithTargetName/aaa09a609b25909839ebda67e942aea7/cf/181a1800f10f46d88e125a73cc94c66b] hfiles 2023-07-15 03:11:04,004 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689390651212)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportWithTargetName/144f7e7eaa33a2d03c4bfb7c41ac453b/cf/2f5136ed0aa043a08e0e90153a03e260] hfiles 2023-07-15 03:11:04,004 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportWithTargetName/aaa09a609b25909839ebda67e942aea7/cf/181a1800f10f46d88e125a73cc94c66b for snapshot=snaptb0-testExportWithTargetName 2023-07-15 03:11:04,004 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689390651212)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportWithTargetName/144f7e7eaa33a2d03c4bfb7c41ac453b/cf/2f5136ed0aa043a08e0e90153a03e260 for snapshot=snaptb0-testExportWithTargetName 2023-07-15 03:11:04,025 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:11:04,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 03:11:04,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-15 03:11:04,031 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 03:11:04,033 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689390661695.aaa09a609b25909839ebda67e942aea7. completed. 2023-07-15 03:11:04,033 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689390651212)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689390661695.144f7e7eaa33a2d03c4bfb7c41ac453b. completed. 2023-07-15 03:11:04,033 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689390651212)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689390661695.144f7e7eaa33a2d03c4bfb7c41ac453b. 2023-07-15 03:11:04,033 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689390661695.aaa09a609b25909839ebda67e942aea7. 2023-07-15 03:11:04,033 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:11:04,033 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:11:04,033 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:11:04,033 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:04,033 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:11:04,034 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-15 03:11:04,034 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:04,034 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37439,1689390651159' in zk 2023-07-15 03:11:04,034 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-15 03:11:04,034 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43379,1689390651212' in zk 2023-07-15 03:11:04,037 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:04,037 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 03:11:04,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:04,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:04,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:04,037 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:04,037 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-15 03:11:04,038 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:04,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:04,038 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 03:11:04,038 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:04,038 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-15 03:11:04,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:04,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 03:11:04,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:04,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:04,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:04,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:04,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 03:11:04,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:04,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:04,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:04,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43379,1689390651212': 2023-07-15 03:11:04,043 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43379,1689390651212' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-15 03:11:04,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:04,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:04,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:04,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:04,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:04,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 03:11:04,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:04,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:04,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:04,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:04,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 03:11:04,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:04,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:04,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:04,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,37439,1689390651159': 2023-07-15 03:11:04,047 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37439,1689390651159' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-15 03:11:04,047 INFO [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-15 03:11:04,047 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 03:11:04,047 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 03:11:04,047 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-15 03:11:04,047 INFO [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 03:11:04,049 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 03:11:04,049 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 03:11:04,049 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 03:11:04,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 03:11:04,049 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 03:11:04,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 03:11:04,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 03:11:04,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 03:11:04,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 03:11:04,049 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:04,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 03:11:04,049 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:04,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 03:11:04,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:04,049 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:04,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:04,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:04,050 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:04,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:04,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:04,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:04,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:04,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:04,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:04,051 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:04,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 03:11:04,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 03:11:04,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 03:11:04,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 03:11:04,051 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:04,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:04,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 03:11:04,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:04,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:04,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:04,053 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:04,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:04,054 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:04,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 03:11:04,054 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:04,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:04,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:04,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:04,064 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:04,065 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:04,065 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:04,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:04,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:04,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:04,065 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:04,065 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:04,065 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:04,065 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:04,066 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 03:11:04,065 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-15 03:11:04,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:04,066 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-15 03:11:04,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:04,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:04,066 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:04,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:04,066 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:04,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:04,066 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:04,066 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-15 03:11:04,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:04,067 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 03:11:04,067 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 03:11:04,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:04,067 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:04,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:04,067 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 03:11:04,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:04,067 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:04,067 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:04,067 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 03:11:04,067 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 03:11:04,068 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023071510475ff66ca54c37b0c8149dc16fc085, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307158ba6ed02a91a4a8ea80872c85fafb11b] mob files 2023-07-15 03:11:04,068 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023071510475ff66ca54c37b0c8149dc16fc085 2023-07-15 03:11:04,068 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307158ba6ed02a91a4a8ea80872c85fafb11b 2023-07-15 03:11:04,081 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-15 03:11:04,081 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-15 03:11:04,118 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-15 03:11:04,154 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-15 03:11:04,154 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-15 03:11:04,154 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-15 03:11:04,155 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689390663719Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689390664081 (+362 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1689390664081Loading Region manifests for snaptb0-testExportWithTargetName at 1689390664081Writing data manifest for snaptb0-testExportWithTargetName at 1689390664086 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689390664107 (+21 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689390664154 (+47 ms) 2023-07-15 03:11:04,156 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 03:11:04,159 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 437 msec 2023-07-15 03:11:04,331 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:11:04,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 03:11:04,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 03:11:04,335 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390664335 2023-07-15 03:11:04,336 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33795, tgtDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390664335, rawTgtDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390664335, srcFsUri=hdfs://localhost:33795, srcDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d 2023-07-15 03:11:04,385 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33795, inputRoot=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d 2023-07-15 03:11:04,385 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-566324167_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390664335, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390664335/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-15 03:11:04,386 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33795, inputRoot=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d, snapshotDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-15 03:11:04,421 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390664335/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-15 03:11:04,567 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:04,568 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:04,569 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:04,569 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:05,650 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/hadoop-4374070374414964865.jar 2023-07-15 03:11:05,651 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:05,652 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:05,729 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/hadoop-8845146980950159215.jar 2023-07-15 03:11:05,729 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:05,730 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:05,730 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:05,731 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:05,731 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:05,732 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:05,732 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 03:11:05,733 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 03:11:05,733 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 03:11:05,733 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 03:11:05,734 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 03:11:05,734 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 03:11:05,735 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 03:11:05,735 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 03:11:05,736 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 03:11:05,736 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 03:11:05,741 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:11:05,742 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:11:05,743 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 03:11:05,743 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:11:05,744 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:11:05,745 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 03:11:05,745 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 03:11:06,729 WARN [Listener at jenkins-hbase4.apache.org/35095] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 03:11:06,735 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-15 03:11:06,744 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-15 03:11:07,327 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 03:11:07,329 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 03:11:07,758 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 03:11:07,813 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660272_0001_000001 (auth:SIMPLE) 2023-07-15 03:11:13,075 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660272_0001_000001 (auth:SIMPLE) 2023-07-15 03:11:15,341 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660272_0001_000001 (auth:SIMPLE) 2023-07-15 03:11:20,703 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 03:11:20,705 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 03:11:20,715 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-15 03:11:20,715 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 03:11:20,716 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 03:11:20,716 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_351679589_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-15 03:11:20,717 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(367): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-15 03:11:20,717 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(367): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-15 03:11:20,717 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_351679589_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390664335/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390664335/.hbase-snapshot/testExportWithTargetName 2023-07-15 03:11:20,718 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(367): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390664335/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-15 03:11:20,718 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(367): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390664335/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-15 03:11:20,728 INFO [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-15 03:11:20,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-15 03:11:20,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-15 03:11:20,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-15 03:11:20,748 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390680748"}]},"ts":"1689390680748"} 2023-07-15 03:11:20,750 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-15 03:11:20,752 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-15 03:11:20,754 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=144f7e7eaa33a2d03c4bfb7c41ac453b, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=aaa09a609b25909839ebda67e942aea7, UNASSIGN}] 2023-07-15 03:11:20,757 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=144f7e7eaa33a2d03c4bfb7c41ac453b, UNASSIGN 2023-07-15 03:11:20,757 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=aaa09a609b25909839ebda67e942aea7, UNASSIGN 2023-07-15 03:11:20,758 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=144f7e7eaa33a2d03c4bfb7c41ac453b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:20,758 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=aaa09a609b25909839ebda67e942aea7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:20,758 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689390661695.144f7e7eaa33a2d03c4bfb7c41ac453b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689390680757"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390680757"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390680757"}]},"ts":"1689390680757"} 2023-07-15 03:11:20,758 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689390661695.aaa09a609b25909839ebda67e942aea7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689390680758"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390680758"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390680758"}]},"ts":"1689390680758"} 2023-07-15 03:11:20,760 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 144f7e7eaa33a2d03c4bfb7c41ac453b, server=jenkins-hbase4.apache.org,43379,1689390651212}] 2023-07-15 03:11:20,761 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure aaa09a609b25909839ebda67e942aea7, server=jenkins-hbase4.apache.org,37439,1689390651159}] 2023-07-15 03:11:20,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-15 03:11:20,921 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close aaa09a609b25909839ebda67e942aea7 2023-07-15 03:11:20,921 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 144f7e7eaa33a2d03c4bfb7c41ac453b 2023-07-15 03:11:20,922 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 144f7e7eaa33a2d03c4bfb7c41ac453b, disabling compactions & flushes 2023-07-15 03:11:20,922 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing aaa09a609b25909839ebda67e942aea7, disabling compactions & flushes 2023-07-15 03:11:20,922 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689390661695.144f7e7eaa33a2d03c4bfb7c41ac453b. 2023-07-15 03:11:20,922 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689390661695.aaa09a609b25909839ebda67e942aea7. 2023-07-15 03:11:20,922 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689390661695.144f7e7eaa33a2d03c4bfb7c41ac453b. 2023-07-15 03:11:20,922 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689390661695.aaa09a609b25909839ebda67e942aea7. 2023-07-15 03:11:20,922 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689390661695.144f7e7eaa33a2d03c4bfb7c41ac453b. after waiting 0 ms 2023-07-15 03:11:20,922 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689390661695.aaa09a609b25909839ebda67e942aea7. after waiting 0 ms 2023-07-15 03:11:20,922 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689390661695.144f7e7eaa33a2d03c4bfb7c41ac453b. 2023-07-15 03:11:20,922 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689390661695.aaa09a609b25909839ebda67e942aea7. 2023-07-15 03:11:20,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportWithTargetName/aaa09a609b25909839ebda67e942aea7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 03:11:20,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportWithTargetName/144f7e7eaa33a2d03c4bfb7c41ac453b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 03:11:20,938 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:11:20,938 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:11:20,939 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689390661695.aaa09a609b25909839ebda67e942aea7. 2023-07-15 03:11:20,939 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689390661695.144f7e7eaa33a2d03c4bfb7c41ac453b. 2023-07-15 03:11:20,939 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for aaa09a609b25909839ebda67e942aea7: 2023-07-15 03:11:20,939 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 144f7e7eaa33a2d03c4bfb7c41ac453b: 2023-07-15 03:11:20,942 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 144f7e7eaa33a2d03c4bfb7c41ac453b 2023-07-15 03:11:20,943 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=144f7e7eaa33a2d03c4bfb7c41ac453b, regionState=CLOSED 2023-07-15 03:11:20,943 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed aaa09a609b25909839ebda67e942aea7 2023-07-15 03:11:20,944 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=aaa09a609b25909839ebda67e942aea7, regionState=CLOSED 2023-07-15 03:11:20,944 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689390661695.aaa09a609b25909839ebda67e942aea7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689390680944"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390680944"}]},"ts":"1689390680944"} 2023-07-15 03:11:20,946 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689390661695.144f7e7eaa33a2d03c4bfb7c41ac453b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689390680943"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390680943"}]},"ts":"1689390680943"} 2023-07-15 03:11:20,949 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-15 03:11:20,949 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure aaa09a609b25909839ebda67e942aea7, server=jenkins-hbase4.apache.org,37439,1689390651159 in 185 msec 2023-07-15 03:11:20,952 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-15 03:11:20,952 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 144f7e7eaa33a2d03c4bfb7c41ac453b, server=jenkins-hbase4.apache.org,43379,1689390651212 in 188 msec 2023-07-15 03:11:20,953 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=aaa09a609b25909839ebda67e942aea7, UNASSIGN in 195 msec 2023-07-15 03:11:20,954 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-15 03:11:20,954 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=144f7e7eaa33a2d03c4bfb7c41ac453b, UNASSIGN in 198 msec 2023-07-15 03:11:20,955 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390680955"}]},"ts":"1689390680955"} 2023-07-15 03:11:20,957 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-15 03:11:20,959 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-15 03:11:20,962 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 224 msec 2023-07-15 03:11:21,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-15 03:11:21,051 INFO [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-15 03:11:21,056 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-15 03:11:21,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 03:11:21,066 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 03:11:21,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-15 03:11:21,068 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 03:11:21,071 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43379] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-15 03:11:21,074 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportWithTargetName/144f7e7eaa33a2d03c4bfb7c41ac453b 2023-07-15 03:11:21,074 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportWithTargetName/aaa09a609b25909839ebda67e942aea7 2023-07-15 03:11:21,075 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 03:11:21,075 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 03:11:21,075 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 03:11:21,075 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 03:11:21,076 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-15 03:11:21,076 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-15 03:11:21,076 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-15 03:11:21,076 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-15 03:11:21,077 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 03:11:21,077 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:11:21,077 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 03:11:21,077 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 03:11:21,077 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:11:21,077 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:11:21,078 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportWithTargetName/aaa09a609b25909839ebda67e942aea7/cf, FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportWithTargetName/aaa09a609b25909839ebda67e942aea7/recovered.edits] 2023-07-15 03:11:21,078 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportWithTargetName/144f7e7eaa33a2d03c4bfb7c41ac453b/cf, FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportWithTargetName/144f7e7eaa33a2d03c4bfb7c41ac453b/recovered.edits] 2023-07-15 03:11:21,078 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 03:11:21,079 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:11:21,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-15 03:11:21,087 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportWithTargetName/144f7e7eaa33a2d03c4bfb7c41ac453b/cf/2f5136ed0aa043a08e0e90153a03e260 to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/archive/data/default/testtb-testExportWithTargetName/144f7e7eaa33a2d03c4bfb7c41ac453b/cf/2f5136ed0aa043a08e0e90153a03e260 2023-07-15 03:11:21,087 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportWithTargetName/aaa09a609b25909839ebda67e942aea7/cf/181a1800f10f46d88e125a73cc94c66b to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/archive/data/default/testtb-testExportWithTargetName/aaa09a609b25909839ebda67e942aea7/cf/181a1800f10f46d88e125a73cc94c66b 2023-07-15 03:11:21,091 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportWithTargetName/144f7e7eaa33a2d03c4bfb7c41ac453b/recovered.edits/9.seqid to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/archive/data/default/testtb-testExportWithTargetName/144f7e7eaa33a2d03c4bfb7c41ac453b/recovered.edits/9.seqid 2023-07-15 03:11:21,091 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportWithTargetName/aaa09a609b25909839ebda67e942aea7/recovered.edits/9.seqid to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/archive/data/default/testtb-testExportWithTargetName/aaa09a609b25909839ebda67e942aea7/recovered.edits/9.seqid 2023-07-15 03:11:21,092 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportWithTargetName/144f7e7eaa33a2d03c4bfb7c41ac453b 2023-07-15 03:11:21,092 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportWithTargetName/aaa09a609b25909839ebda67e942aea7 2023-07-15 03:11:21,092 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-15 03:11:21,092 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-15 03:11:21,093 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-15 03:11:21,097 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023071510475ff66ca54c37b0c8149dc16fc085 to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023071510475ff66ca54c37b0c8149dc16fc085 2023-07-15 03:11:21,098 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307158ba6ed02a91a4a8ea80872c85fafb11b to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307158ba6ed02a91a4a8ea80872c85fafb11b 2023-07-15 03:11:21,099 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-15 03:11:21,102 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 03:11:21,124 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-15 03:11:21,127 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-15 03:11:21,129 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 03:11:21,129 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-15 03:11:21,129 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689390661695.144f7e7eaa33a2d03c4bfb7c41ac453b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689390681129"}]},"ts":"9223372036854775807"} 2023-07-15 03:11:21,129 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689390661695.aaa09a609b25909839ebda67e942aea7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689390681129"}]},"ts":"9223372036854775807"} 2023-07-15 03:11:21,131 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 03:11:21,131 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 144f7e7eaa33a2d03c4bfb7c41ac453b, NAME => 'testtb-testExportWithTargetName,,1689390661695.144f7e7eaa33a2d03c4bfb7c41ac453b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => aaa09a609b25909839ebda67e942aea7, NAME => 'testtb-testExportWithTargetName,1,1689390661695.aaa09a609b25909839ebda67e942aea7.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 03:11:21,131 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-15 03:11:21,132 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689390681132"}]},"ts":"9223372036854775807"} 2023-07-15 03:11:21,133 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-15 03:11:21,136 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 03:11:21,138 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 79 msec 2023-07-15 03:11:21,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-15 03:11:21,189 INFO [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-15 03:11:21,206 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-15 03:11:21,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-15 03:11:21,211 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-15 03:11:21,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-15 03:11:21,243 INFO [Listener at jenkins-hbase4.apache.org/35095] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=749 (was 702) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2eee99d1-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/cluster_28d9752d-d2d9-87a3-fd7d-03f24d387c2d/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_351679589_17 at /127.0.0.1:38022 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2002462187_1 at /127.0.0.1:46768 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2eee99d1-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/cluster_28d9752d-d2d9-87a3-fd7d-03f24d387c2d/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/cluster_28d9752d-d2d9-87a3-fd7d-03f24d387c2d/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/cluster_28d9752d-d2d9-87a3-fd7d-03f24d387c2d/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2eee99d1-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1575588394) connection to jenkins-hbase4.apache.org/172.31.14.131:37599 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1575588394) connection to jenkins-hbase4.apache.org/172.31.14.131:37601 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/cluster_28d9752d-d2d9-87a3-fd7d-03f24d387c2d/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_351679589_17 at /127.0.0.1:50846 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2002462187_1 at /127.0.0.1:59980 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/cluster_28d9752d-d2d9-87a3-fd7d-03f24d387c2d/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1575588394) connection to jenkins-hbase4.apache.org/172.31.14.131:42311 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2eee99d1-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1315 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=931 (was 896) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=382 (was 252) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 174) - ProcessCount LEAK? -, AvailableMemoryMB=2472 (was 4301) 2023-07-15 03:11:21,243 WARN [Listener at jenkins-hbase4.apache.org/35095] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-07-15 03:11:21,264 INFO [Listener at jenkins-hbase4.apache.org/35095] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=749, OpenFileDescriptor=931, MaxFileDescriptor=60000, SystemLoadAverage=382, ProcessCount=180, AvailableMemoryMB=2471 2023-07-15 03:11:21,264 WARN [Listener at jenkins-hbase4.apache.org/35095] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-07-15 03:11:21,266 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-15 03:11:21,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-15 03:11:21,271 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 03:11:21,273 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-15 03:11:21,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-15 03:11:21,274 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 03:11:21,277 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemState/9f140346c421510833ef03f0a2248555 2023-07-15 03:11:21,277 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemState/a2b342b1804c2f6cb41a2c4fc0fff9e8 2023-07-15 03:11:21,278 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemState/9f140346c421510833ef03f0a2248555 empty. 2023-07-15 03:11:21,278 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemState/a2b342b1804c2f6cb41a2c4fc0fff9e8 empty. 2023-07-15 03:11:21,278 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemState/9f140346c421510833ef03f0a2248555 2023-07-15 03:11:21,278 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemState/a2b342b1804c2f6cb41a2c4fc0fff9e8 2023-07-15 03:11:21,278 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-15 03:11:21,290 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-15 03:11:21,291 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9f140346c421510833ef03f0a2248555, NAME => 'testtb-testExportFileSystemState,,1689390681265.9f140346c421510833ef03f0a2248555.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp 2023-07-15 03:11:21,292 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => a2b342b1804c2f6cb41a2c4fc0fff9e8, NAME => 'testtb-testExportFileSystemState,1,1689390681265.a2b342b1804c2f6cb41a2c4fc0fff9e8.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp 2023-07-15 03:11:21,311 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689390681265.a2b342b1804c2f6cb41a2c4fc0fff9e8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:11:21,311 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing a2b342b1804c2f6cb41a2c4fc0fff9e8, disabling compactions & flushes 2023-07-15 03:11:21,312 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689390681265.a2b342b1804c2f6cb41a2c4fc0fff9e8. 2023-07-15 03:11:21,312 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689390681265.a2b342b1804c2f6cb41a2c4fc0fff9e8. 2023-07-15 03:11:21,312 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689390681265.a2b342b1804c2f6cb41a2c4fc0fff9e8. after waiting 0 ms 2023-07-15 03:11:21,312 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689390681265.a2b342b1804c2f6cb41a2c4fc0fff9e8. 2023-07-15 03:11:21,312 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689390681265.a2b342b1804c2f6cb41a2c4fc0fff9e8. 2023-07-15 03:11:21,312 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689390681265.9f140346c421510833ef03f0a2248555.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:11:21,312 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for a2b342b1804c2f6cb41a2c4fc0fff9e8: 2023-07-15 03:11:21,313 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 9f140346c421510833ef03f0a2248555, disabling compactions & flushes 2023-07-15 03:11:21,313 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689390681265.9f140346c421510833ef03f0a2248555. 2023-07-15 03:11:21,313 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689390681265.9f140346c421510833ef03f0a2248555. 2023-07-15 03:11:21,313 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689390681265.9f140346c421510833ef03f0a2248555. after waiting 0 ms 2023-07-15 03:11:21,313 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689390681265.9f140346c421510833ef03f0a2248555. 2023-07-15 03:11:21,313 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689390681265.9f140346c421510833ef03f0a2248555. 2023-07-15 03:11:21,313 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 9f140346c421510833ef03f0a2248555: 2023-07-15 03:11:21,316 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 03:11:21,317 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689390681265.a2b342b1804c2f6cb41a2c4fc0fff9e8.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689390681317"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390681317"}]},"ts":"1689390681317"} 2023-07-15 03:11:21,317 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689390681265.9f140346c421510833ef03f0a2248555.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689390681317"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390681317"}]},"ts":"1689390681317"} 2023-07-15 03:11:21,320 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 03:11:21,321 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 03:11:21,321 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390681321"}]},"ts":"1689390681321"} 2023-07-15 03:11:21,323 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-15 03:11:21,328 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 03:11:21,329 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 03:11:21,329 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 03:11:21,329 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 03:11:21,329 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 03:11:21,330 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9f140346c421510833ef03f0a2248555, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a2b342b1804c2f6cb41a2c4fc0fff9e8, ASSIGN}] 2023-07-15 03:11:21,332 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a2b342b1804c2f6cb41a2c4fc0fff9e8, ASSIGN 2023-07-15 03:11:21,332 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9f140346c421510833ef03f0a2248555, ASSIGN 2023-07-15 03:11:21,334 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a2b342b1804c2f6cb41a2c4fc0fff9e8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37439,1689390651159; forceNewPlan=false, retain=false 2023-07-15 03:11:21,334 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9f140346c421510833ef03f0a2248555, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40245,1689390651089; forceNewPlan=false, retain=false 2023-07-15 03:11:21,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-15 03:11:21,484 INFO [jenkins-hbase4:45731] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 03:11:21,486 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=a2b342b1804c2f6cb41a2c4fc0fff9e8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:21,486 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=9f140346c421510833ef03f0a2248555, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:21,487 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689390681265.a2b342b1804c2f6cb41a2c4fc0fff9e8.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689390681486"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390681486"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390681486"}]},"ts":"1689390681486"} 2023-07-15 03:11:21,487 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689390681265.9f140346c421510833ef03f0a2248555.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689390681486"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390681486"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390681486"}]},"ts":"1689390681486"} 2023-07-15 03:11:21,489 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure a2b342b1804c2f6cb41a2c4fc0fff9e8, server=jenkins-hbase4.apache.org,37439,1689390651159}] 2023-07-15 03:11:21,490 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 9f140346c421510833ef03f0a2248555, server=jenkins-hbase4.apache.org,40245,1689390651089}] 2023-07-15 03:11:21,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-15 03:11:21,645 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:21,645 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 03:11:21,646 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689390681265.a2b342b1804c2f6cb41a2c4fc0fff9e8. 2023-07-15 03:11:21,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a2b342b1804c2f6cb41a2c4fc0fff9e8, NAME => 'testtb-testExportFileSystemState,1,1689390681265.a2b342b1804c2f6cb41a2c4fc0fff9e8.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 03:11:21,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689390681265.a2b342b1804c2f6cb41a2c4fc0fff9e8. service=AccessControlService 2023-07-15 03:11:21,649 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 03:11:21,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState a2b342b1804c2f6cb41a2c4fc0fff9e8 2023-07-15 03:11:21,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689390681265.a2b342b1804c2f6cb41a2c4fc0fff9e8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:11:21,649 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36984, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 03:11:21,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a2b342b1804c2f6cb41a2c4fc0fff9e8 2023-07-15 03:11:21,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a2b342b1804c2f6cb41a2c4fc0fff9e8 2023-07-15 03:11:21,653 INFO [StoreOpener-a2b342b1804c2f6cb41a2c4fc0fff9e8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a2b342b1804c2f6cb41a2c4fc0fff9e8 2023-07-15 03:11:21,657 DEBUG [StoreOpener-a2b342b1804c2f6cb41a2c4fc0fff9e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemState/a2b342b1804c2f6cb41a2c4fc0fff9e8/cf 2023-07-15 03:11:21,657 DEBUG [StoreOpener-a2b342b1804c2f6cb41a2c4fc0fff9e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemState/a2b342b1804c2f6cb41a2c4fc0fff9e8/cf 2023-07-15 03:11:21,657 INFO [StoreOpener-a2b342b1804c2f6cb41a2c4fc0fff9e8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a2b342b1804c2f6cb41a2c4fc0fff9e8 columnFamilyName cf 2023-07-15 03:11:21,659 INFO [StoreOpener-a2b342b1804c2f6cb41a2c4fc0fff9e8-1] regionserver.HStore(310): Store=a2b342b1804c2f6cb41a2c4fc0fff9e8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:11:21,663 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689390681265.9f140346c421510833ef03f0a2248555. 2023-07-15 03:11:21,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9f140346c421510833ef03f0a2248555, NAME => 'testtb-testExportFileSystemState,,1689390681265.9f140346c421510833ef03f0a2248555.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 03:11:21,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemState/a2b342b1804c2f6cb41a2c4fc0fff9e8 2023-07-15 03:11:21,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689390681265.9f140346c421510833ef03f0a2248555. service=AccessControlService 2023-07-15 03:11:21,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemState/a2b342b1804c2f6cb41a2c4fc0fff9e8 2023-07-15 03:11:21,665 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 03:11:21,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 9f140346c421510833ef03f0a2248555 2023-07-15 03:11:21,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689390681265.9f140346c421510833ef03f0a2248555.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:11:21,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9f140346c421510833ef03f0a2248555 2023-07-15 03:11:21,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9f140346c421510833ef03f0a2248555 2023-07-15 03:11:21,667 INFO [StoreOpener-9f140346c421510833ef03f0a2248555-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9f140346c421510833ef03f0a2248555 2023-07-15 03:11:21,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a2b342b1804c2f6cb41a2c4fc0fff9e8 2023-07-15 03:11:21,669 DEBUG [StoreOpener-9f140346c421510833ef03f0a2248555-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemState/9f140346c421510833ef03f0a2248555/cf 2023-07-15 03:11:21,669 DEBUG [StoreOpener-9f140346c421510833ef03f0a2248555-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemState/9f140346c421510833ef03f0a2248555/cf 2023-07-15 03:11:21,670 INFO [StoreOpener-9f140346c421510833ef03f0a2248555-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9f140346c421510833ef03f0a2248555 columnFamilyName cf 2023-07-15 03:11:21,671 INFO [StoreOpener-9f140346c421510833ef03f0a2248555-1] regionserver.HStore(310): Store=9f140346c421510833ef03f0a2248555/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:11:21,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemState/a2b342b1804c2f6cb41a2c4fc0fff9e8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 03:11:21,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemState/9f140346c421510833ef03f0a2248555 2023-07-15 03:11:21,679 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a2b342b1804c2f6cb41a2c4fc0fff9e8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67558058, jitterRate=0.006693512201309204}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 03:11:21,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemState/9f140346c421510833ef03f0a2248555 2023-07-15 03:11:21,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a2b342b1804c2f6cb41a2c4fc0fff9e8: 2023-07-15 03:11:21,680 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689390681265.a2b342b1804c2f6cb41a2c4fc0fff9e8., pid=30, masterSystemTime=1689390681641 2023-07-15 03:11:21,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689390681265.a2b342b1804c2f6cb41a2c4fc0fff9e8. 2023-07-15 03:11:21,682 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689390681265.a2b342b1804c2f6cb41a2c4fc0fff9e8. 2023-07-15 03:11:21,683 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=a2b342b1804c2f6cb41a2c4fc0fff9e8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:21,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9f140346c421510833ef03f0a2248555 2023-07-15 03:11:21,684 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689390681265.a2b342b1804c2f6cb41a2c4fc0fff9e8.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689390681683"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689390681683"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689390681683"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689390681683"}]},"ts":"1689390681683"} 2023-07-15 03:11:21,688 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-15 03:11:21,689 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure a2b342b1804c2f6cb41a2c4fc0fff9e8, server=jenkins-hbase4.apache.org,37439,1689390651159 in 197 msec 2023-07-15 03:11:21,690 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a2b342b1804c2f6cb41a2c4fc0fff9e8, ASSIGN in 360 msec 2023-07-15 03:11:21,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemState/9f140346c421510833ef03f0a2248555/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 03:11:21,697 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9f140346c421510833ef03f0a2248555; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59304432, jitterRate=-0.11629509925842285}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 03:11:21,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9f140346c421510833ef03f0a2248555: 2023-07-15 03:11:21,698 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689390681265.9f140346c421510833ef03f0a2248555., pid=31, masterSystemTime=1689390681645 2023-07-15 03:11:21,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689390681265.9f140346c421510833ef03f0a2248555. 2023-07-15 03:11:21,704 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689390681265.9f140346c421510833ef03f0a2248555. 2023-07-15 03:11:21,705 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=9f140346c421510833ef03f0a2248555, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:21,705 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689390681265.9f140346c421510833ef03f0a2248555.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689390681705"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689390681705"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689390681705"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689390681705"}]},"ts":"1689390681705"} 2023-07-15 03:11:21,710 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-15 03:11:21,710 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 9f140346c421510833ef03f0a2248555, server=jenkins-hbase4.apache.org,40245,1689390651089 in 217 msec 2023-07-15 03:11:21,713 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-15 03:11:21,717 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9f140346c421510833ef03f0a2248555, ASSIGN in 381 msec 2023-07-15 03:11:21,718 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 03:11:21,718 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390681718"}]},"ts":"1689390681718"} 2023-07-15 03:11:21,720 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-15 03:11:21,723 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 03:11:21,724 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-15 03:11:21,726 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43379] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 03:11:21,729 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:11:21,729 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:11:21,729 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:11:21,729 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:11:21,731 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 03:11:21,731 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 03:11:21,731 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 03:11:21,731 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 03:11:21,733 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 463 msec 2023-07-15 03:11:21,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-15 03:11:21,878 INFO [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-15 03:11:21,881 DEBUG [Listener at jenkins-hbase4.apache.org/35095] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-15 03:11:21,882 DEBUG [Listener at jenkins-hbase4.apache.org/35095] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689390681265.9f140346c421510833ef03f0a2248555. 2023-07-15 03:11:21,885 INFO [Listener at jenkins-hbase4.apache.org/35095] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 03:11:21,894 DEBUG [hconnection-0x4f3276c6-shared-pool-10] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:11:21,899 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36998, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:11:21,905 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 03:11:21,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689390681905 (current time:1689390681905). 2023-07-15 03:11:21,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 03:11:21,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(139): Connect 0x0b8eae79 to 127.0.0.1:58749 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:11:21,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@694445f4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:11:21,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:11:21,916 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49162, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:11:21,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0b8eae79 to 127.0.0.1:58749 2023-07-15 03:11:21,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:11:21,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(139): Connect 0x2949c736 to 127.0.0.1:58749 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:11:21,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@574a4900, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:11:21,925 DEBUG [hconnection-0x1ceacdf8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:11:21,928 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49170, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:11:21,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:11:21,932 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42510, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:11:21,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2949c736 to 127.0.0.1:58749 2023-07-15 03:11:21,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:11:21,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 03:11:21,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 03:11:21,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 03:11:21,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 03:11:21,937 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 03:11:21,938 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689391281938 2023-07-15 03:11:21,938 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-15 03:11:21,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 03:11:21,939 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 03:11:21,940 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 03:11:21,941 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 03:11:21,941 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 03:11:21,945 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-15 03:11:21,946 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 03:11:21,947 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689391281947 2023-07-15 03:11:21,971 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:21,971 INFO [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-15 03:11:21,971 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:21,973 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-15 03:11:21,973 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-15 03:11:21,973 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:21,973 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:21,975 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:21,975 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:21,975 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:21,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:21,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:21,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:21,975 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:21,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:21,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:21,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:21,976 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:21,976 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:21,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:21,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:21,976 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:21,976 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 03:11:21,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:21,976 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:21,977 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:21,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-15 03:11:21,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:21,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-15 03:11:21,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:21,977 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 03:11:21,977 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 03:11:21,977 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:21,978 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 03:11:21,978 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:21,978 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:21,978 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 03:11:21,979 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 03:11:21,979 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-15 03:11:21,978 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:21,979 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43379,1689390651212' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-15 03:11:21,979 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:21,981 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 03:11:21,981 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-15 03:11:21,981 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40245,1689390651089' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-15 03:11:21,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-15 03:11:21,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:21,981 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 03:11:21,982 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:21,986 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:21,986 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 03:11:21,986 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:21,987 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 03:11:21,987 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-15 03:11:21,987 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37439,1689390651159' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-15 03:11:21,993 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:21,993 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:21,993 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:11:21,993 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:21,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:21,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:21,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:21,995 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:21,995 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:21,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:21,995 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:21,995 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:11:21,995 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:21,995 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:11:21,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:21,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:21,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:21,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:21,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:21,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:21,997 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40245,1689390651089' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-15 03:11:21,997 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@293849eb[Count = 1] remaining members to acquire global barrier 2023-07-15 03:11:21,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:21,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:21,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:21,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:21,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:21,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:21,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:21,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:21,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:21,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:21,999 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37439,1689390651159' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-15 03:11:21,999 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@293849eb[Count = 0] remaining members to acquire global barrier 2023-07-15 03:11:21,999 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-15 03:11:21,999 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:22,000 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:22,001 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:22,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:22,000 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:22,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:22,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:22,001 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:22,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:22,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:22,001 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 03:11:22,001 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 03:11:22,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:22,001 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 03:11:22,001 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:22,001 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 03:11:22,001 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:11:22,001 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:11:22,001 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689390681265.9f140346c421510833ef03f0a2248555. 2023-07-15 03:11:22,002 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689390681265.9f140346c421510833ef03f0a2248555. started... 2023-07-15 03:11:22,001 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-15 03:11:22,001 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689390681265.a2b342b1804c2f6cb41a2c4fc0fff9e8. 2023-07-15 03:11:22,001 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:11:22,002 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689390681265.a2b342b1804c2f6cb41a2c4fc0fff9e8. started... 2023-07-15 03:11:22,002 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9f140346c421510833ef03f0a2248555: 2023-07-15 03:11:22,002 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43379,1689390651212' in zk 2023-07-15 03:11:22,002 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:11:22,004 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a2b342b1804c2f6cb41a2c4fc0fff9e8: 2023-07-15 03:11:22,004 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689390681265.9f140346c421510833ef03f0a2248555.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:22,004 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:11:22,004 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 03:11:22,004 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689390681265.a2b342b1804c2f6cb41a2c4fc0fff9e8.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:22,005 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:11:22,005 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 03:11:22,005 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 03:11:22,005 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:22,005 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-15 03:11:22,021 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689390681265.9f140346c421510833ef03f0a2248555. completed. 2023-07-15 03:11:22,022 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689390681265.9f140346c421510833ef03f0a2248555. 2023-07-15 03:11:22,022 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:11:22,022 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:11:22,022 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:22,022 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-15 03:11:22,022 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40245,1689390651089' in zk 2023-07-15 03:11:22,022 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689390681265.a2b342b1804c2f6cb41a2c4fc0fff9e8. completed. 2023-07-15 03:11:22,022 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689390681265.a2b342b1804c2f6cb41a2c4fc0fff9e8. 2023-07-15 03:11:22,022 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:11:22,022 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:11:22,022 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:22,022 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-15 03:11:22,022 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37439,1689390651159' in zk 2023-07-15 03:11:22,025 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:22,025 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 03:11:22,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:22,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:22,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:22,025 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:22,025 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-15 03:11:22,026 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 03:11:22,026 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:22,026 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:22,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:22,026 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-15 03:11:22,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:22,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:22,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:22,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:22,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:22,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:22,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:22,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:22,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:22,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:22,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,40245,1689390651089': 2023-07-15 03:11:22,031 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40245,1689390651089' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-15 03:11:22,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:22,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:22,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:22,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:22,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:22,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:22,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:22,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:22,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:22,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:22,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:22,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:22,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:22,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:22,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,37439,1689390651159': 2023-07-15 03:11:22,036 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37439,1689390651159' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-15 03:11:22,036 INFO [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-15 03:11:22,036 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 03:11:22,036 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 03:11:22,036 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:22,036 INFO [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 03:11:22,038 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:22,038 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:22,038 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:22,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:22,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:22,038 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:22,038 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:22,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:22,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:22,039 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:22,039 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:22,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:22,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:22,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:22,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:22,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:22,040 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:11:22,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:22,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:22,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:22,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:22,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 03:11:22,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 03:11:22,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:22,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:22,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:22,042 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 03:11:22,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:22,042 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:22,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:22,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:22,042 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:22,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:22,043 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:22,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:22,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:22,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:22,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:22,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:22,045 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:22,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:22,046 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:22,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:22,046 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:22,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:22,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:22,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:22,049 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:22,049 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:22,050 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:22,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:22,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:22,050 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:22,050 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:22,050 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:22,050 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:22,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:22,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:22,050 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:22,050 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:22,050 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-15 03:11:22,050 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:22,050 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:22,050 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:22,050 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 03:11:22,050 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:22,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:22,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:22,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:22,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:22,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:22,050 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:22,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:22,052 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:22,053 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:22,053 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:22,053 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:22,053 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:22,053 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:22,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-15 03:11:22,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:22,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:22,067 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:22,068 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:22,101 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:22,154 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-15 03:11:22,154 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:22,155 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:22,155 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689390681938Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689390682067 (+129 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689390682067Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689390682068 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689390682073 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689390682094 (+21 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689390682154 (+60 ms) 2023-07-15 03:11:22,158 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 03:11:22,160 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 219 msec 2023-07-15 03:11:22,242 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:11:22,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 03:11:22,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 03:11:22,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40245] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689390681265.9f140346c421510833ef03f0a2248555. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 03:11:22,257 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37439] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689390681265.a2b342b1804c2f6cb41a2c4fc0fff9e8. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 03:11:22,266 DEBUG [Listener at jenkins-hbase4.apache.org/35095] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-15 03:11:22,266 DEBUG [Listener at jenkins-hbase4.apache.org/35095] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689390681265.9f140346c421510833ef03f0a2248555. 2023-07-15 03:11:22,267 INFO [Listener at jenkins-hbase4.apache.org/35095] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 03:11:22,286 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 03:11:22,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689390682286 (current time:1689390682286). 2023-07-15 03:11:22,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 03:11:22,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(139): Connect 0x361e913e to 127.0.0.1:58749 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:11:22,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@227e6dc8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:11:22,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:11:22,299 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49172, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:11:22,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x361e913e to 127.0.0.1:58749 2023-07-15 03:11:22,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:11:22,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(139): Connect 0x1de58c96 to 127.0.0.1:58749 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:11:22,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e715f66, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:11:22,318 DEBUG [hconnection-0x701a1f9b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:11:22,319 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49186, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:11:22,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:11:22,326 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42524, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:11:22,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1de58c96 to 127.0.0.1:58749 2023-07-15 03:11:22,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:11:22,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 03:11:22,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 03:11:22,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 03:11:22,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 03:11:22,332 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 03:11:22,333 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689391282333 2023-07-15 03:11:22,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 03:11:22,333 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-15 03:11:22,334 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 03:11:22,334 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 03:11:22,335 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 03:11:22,335 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 03:11:22,337 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-15 03:11:22,338 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 03:11:22,339 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689391282339 2023-07-15 03:11:22,354 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-15 03:11:22,355 INFO [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-15 03:11:22,355 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:22,356 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-15 03:11:22,356 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-15 03:11:22,357 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,357 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,358 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:22,358 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:22,358 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:22,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:22,359 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:22,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:22,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:22,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:22,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:22,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:22,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,359 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:22,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,359 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:22,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,360 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,360 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,360 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:22,360 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 03:11:22,360 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-15 03:11:22,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-15 03:11:22,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,360 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 03:11:22,360 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 03:11:22,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-15 03:11:22,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,361 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 03:11:22,366 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-15 03:11:22,366 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-15 03:11:22,366 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-15 03:11:22,366 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 03:11:22,366 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 03:11:22,366 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 03:11:22,366 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:22,366 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:22,368 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 03:11:22,369 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-15 03:11:22,366 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:22,369 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43379,1689390651212' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-15 03:11:22,370 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 03:11:22,370 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-15 03:11:22,369 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 03:11:22,370 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-15 03:11:22,370 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37439,1689390651159' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-15 03:11:22,371 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40245,1689390651089' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-15 03:11:22,373 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,377 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:22,377 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:22,377 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:22,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:22,377 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:22,377 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,377 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:11:22,377 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,377 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:11:22,378 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,378 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:11:22,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:22,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:22,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 03:11:22,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:22,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:22,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:22,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:22,381 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37439,1689390651159' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-15 03:11:22,381 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39a986d3[Count = 1] remaining members to acquire global barrier 2023-07-15 03:11:22,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:22,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:22,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:22,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:22,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:22,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 03:11:22,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:22,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:22,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:22,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:22,384 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40245,1689390651089' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-15 03:11:22,384 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39a986d3[Count = 0] remaining members to acquire global barrier 2023-07-15 03:11:22,384 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-15 03:11:22,384 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,386 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,386 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,386 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 03:11:22,386 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 03:11:22,386 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-15 03:11:22,386 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43379,1689390651212' in zk 2023-07-15 03:11:22,387 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:11:22,387 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:11:22,387 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689390681265.9f140346c421510833ef03f0a2248555. 2023-07-15 03:11:22,387 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689390681265.9f140346c421510833ef03f0a2248555. started... 2023-07-15 03:11:22,387 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,387 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 03:11:22,387 INFO [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9f140346c421510833ef03f0a2248555 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-15 03:11:22,388 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 03:11:22,388 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:22,389 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-15 03:11:22,391 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:11:22,391 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:11:22,391 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:22,391 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689390681265.a2b342b1804c2f6cb41a2c4fc0fff9e8. 2023-07-15 03:11:22,391 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689390681265.a2b342b1804c2f6cb41a2c4fc0fff9e8. started... 2023-07-15 03:11:22,391 INFO [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a2b342b1804c2f6cb41a2c4fc0fff9e8 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-15 03:11:22,391 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:22,392 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 03:11:22,434 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:11:22,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 03:11:22,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 03:11:22,436 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 03:11:22,456 INFO [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230715e2c115a8f5584153863c7c782b73fd24 to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230715e2c115a8f5584153863c7c782b73fd24 2023-07-15 03:11:22,467 INFO [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230715d4cda46682674305abc961e79e836458 to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230715d4cda46682674305abc961e79e836458 2023-07-15 03:11:22,496 INFO [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemState/a2b342b1804c2f6cb41a2c4fc0fff9e8/.tmp/cf/a8d1975a3d7940ba918b8a902d0089f0 2023-07-15 03:11:22,506 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemState/a2b342b1804c2f6cb41a2c4fc0fff9e8/.tmp/cf/a8d1975a3d7940ba918b8a902d0089f0 as hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemState/a2b342b1804c2f6cb41a2c4fc0fff9e8/cf/a8d1975a3d7940ba918b8a902d0089f0 2023-07-15 03:11:22,518 INFO [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemState/9f140346c421510833ef03f0a2248555/.tmp/cf/a6482998e9534d1793a86f3565cc2d41 2023-07-15 03:11:22,524 INFO [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemState/a2b342b1804c2f6cb41a2c4fc0fff9e8/cf/a8d1975a3d7940ba918b8a902d0089f0, entries=47, sequenceid=6, filesize=12.8 K 2023-07-15 03:11:22,525 INFO [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for a2b342b1804c2f6cb41a2c4fc0fff9e8 in 134ms, sequenceid=6, compaction requested=false 2023-07-15 03:11:22,525 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-15 03:11:22,526 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a2b342b1804c2f6cb41a2c4fc0fff9e8: 2023-07-15 03:11:22,526 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689390681265.a2b342b1804c2f6cb41a2c4fc0fff9e8.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-15 03:11:22,526 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:11:22,526 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemState/a2b342b1804c2f6cb41a2c4fc0fff9e8/cf/a8d1975a3d7940ba918b8a902d0089f0] hfiles 2023-07-15 03:11:22,526 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemState/a2b342b1804c2f6cb41a2c4fc0fff9e8/cf/a8d1975a3d7940ba918b8a902d0089f0 for snapshot=snaptb0-testExportFileSystemState 2023-07-15 03:11:22,530 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemState/9f140346c421510833ef03f0a2248555/.tmp/cf/a6482998e9534d1793a86f3565cc2d41 as hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemState/9f140346c421510833ef03f0a2248555/cf/a6482998e9534d1793a86f3565cc2d41 2023-07-15 03:11:22,540 INFO [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemState/9f140346c421510833ef03f0a2248555/cf/a6482998e9534d1793a86f3565cc2d41, entries=3, sequenceid=6, filesize=5.4 K 2023-07-15 03:11:22,541 INFO [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 9f140346c421510833ef03f0a2248555 in 154ms, sequenceid=6, compaction requested=false 2023-07-15 03:11:22,548 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9f140346c421510833ef03f0a2248555: 2023-07-15 03:11:22,549 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689390681265.9f140346c421510833ef03f0a2248555.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-15 03:11:22,549 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:11:22,549 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemState/9f140346c421510833ef03f0a2248555/cf/a6482998e9534d1793a86f3565cc2d41] hfiles 2023-07-15 03:11:22,549 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemState/9f140346c421510833ef03f0a2248555/cf/a6482998e9534d1793a86f3565cc2d41 for snapshot=snaptb0-testExportFileSystemState 2023-07-15 03:11:22,555 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689390681265.a2b342b1804c2f6cb41a2c4fc0fff9e8. completed. 2023-07-15 03:11:22,555 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689390681265.a2b342b1804c2f6cb41a2c4fc0fff9e8. 2023-07-15 03:11:22,555 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:11:22,555 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:11:22,555 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:22,555 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-15 03:11:22,555 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37439,1689390651159' in zk 2023-07-15 03:11:22,562 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 03:11:22,562 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:22,562 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:22,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:22,562 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-15 03:11:22,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:22,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:22,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:22,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:22,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 03:11:22,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:22,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:22,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:22,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:22,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 03:11:22,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:22,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:22,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,37439,1689390651159': 2023-07-15 03:11:22,575 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37439,1689390651159' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-15 03:11:22,578 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689390681265.9f140346c421510833ef03f0a2248555. completed. 2023-07-15 03:11:22,578 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689390681265.9f140346c421510833ef03f0a2248555. 2023-07-15 03:11:22,578 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:11:22,579 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:11:22,579 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:22,579 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-15 03:11:22,579 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40245,1689390651089' in zk 2023-07-15 03:11:22,581 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:22,581 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 03:11:22,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:22,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:22,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:22,581 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:22,582 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-15 03:11:22,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:22,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:22,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 03:11:22,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:22,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:22,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:22,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:22,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 03:11:22,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:22,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:22,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:22,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,40245,1689390651089': 2023-07-15 03:11:22,588 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40245,1689390651089' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-15 03:11:22,588 INFO [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-15 03:11:22,588 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 03:11:22,588 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 03:11:22,588 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-15 03:11:22,589 INFO [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 03:11:22,590 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,591 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,591 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,591 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:22,591 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:22,591 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,591 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:22,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,591 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:22,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:22,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:22,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:22,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:22,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:22,592 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:22,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:22,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:22,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:22,592 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:22,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:22,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 03:11:22,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:22,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 03:11:22,595 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:22,597 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:22,597 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:22,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:22,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:22,602 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:22,602 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,602 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:22,603 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:22,603 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,603 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:22,603 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:22,603 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:22,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:22,603 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:22,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:22,603 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,603 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:22,603 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:22,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:22,603 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:22,603 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-15 03:11:22,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:22,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:22,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:22,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:22,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:22,603 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:22,603 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:22,605 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-15 03:11:22,605 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:22,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:22,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:22,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:22,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:22,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:22,607 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-15 03:11:22,607 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,607 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 03:11:22,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:22,607 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,607 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState because node does not exist (not an error) 2023-07-15 03:11:22,608 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230715e2c115a8f5584153863c7c782b73fd24, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230715d4cda46682674305abc961e79e836458] mob files 2023-07-15 03:11:22,608 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230715e2c115a8f5584153863c7c782b73fd24 2023-07-15 03:11:22,608 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230715d4cda46682674305abc961e79e836458 2023-07-15 03:11:22,620 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-15 03:11:22,620 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,636 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:11:22,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 03:11:22,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 03:11:22,638 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 03:11:22,666 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,692 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-15 03:11:22,692 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,692 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,692 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689390682333Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689390682620 (+287 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1689390682620Loading Region manifests for snaptb0-testExportFileSystemState at 1689390682620Writing data manifest for snaptb0-testExportFileSystemState at 1689390682626 (+6 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689390682656 (+30 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689390682692 (+36 ms) 2023-07-15 03:11:22,695 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 03:11:22,697 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 361 msec 2023-07-15 03:11:22,938 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:11:22,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 03:11:22,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 03:11:22,940 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390682940 2023-07-15 03:11:22,940 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33795, tgtDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390682940, rawTgtDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390682940, srcFsUri=hdfs://localhost:33795, srcDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d 2023-07-15 03:11:22,974 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33795, inputRoot=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d 2023-07-15 03:11:22,974 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1693357145_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390682940, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390682940/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-15 03:11:22,974 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33795, inputRoot=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d, snapshotDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-15 03:11:22,989 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390682940/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-15 03:11:23,007 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:23,007 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:23,008 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:23,008 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:23,972 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/hadoop-1070873071389795262.jar 2023-07-15 03:11:23,973 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:23,974 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:24,047 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/hadoop-6242727162423435770.jar 2023-07-15 03:11:24,048 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:24,048 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:24,049 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:24,049 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:24,049 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:24,050 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:24,050 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 03:11:24,051 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 03:11:24,051 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 03:11:24,051 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 03:11:24,052 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 03:11:24,052 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 03:11:24,053 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 03:11:24,053 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 03:11:24,053 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 03:11:24,054 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 03:11:24,054 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:11:24,055 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:11:24,055 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 03:11:24,056 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:11:24,056 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:11:24,056 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 03:11:24,057 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 03:11:24,954 WARN [Listener at jenkins-hbase4.apache.org/35095] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 03:11:24,957 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-15 03:11:24,959 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-15 03:11:25,446 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 03:11:25,446 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 03:11:25,453 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660272_0001_000001 (auth:SIMPLE) 2023-07-15 03:11:26,200 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660272_0002_000001 (auth:SIMPLE) 2023-07-15 03:11:26,543 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 03:11:30,816 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660272_0002_000001 (auth:SIMPLE) 2023-07-15 03:11:33,047 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660272_0002_000001 (auth:SIMPLE) 2023-07-15 03:11:35,897 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660272_0002_000001 (auth:SIMPLE) 2023-07-15 03:11:37,167 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 03:11:37,170 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 03:11:37,180 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-15 03:11:37,180 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 03:11:37,181 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 03:11:37,181 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_351679589_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-15 03:11:37,181 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(367): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-15 03:11:37,182 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(367): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-15 03:11:37,182 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_351679589_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390682940/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390682940/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-15 03:11:37,182 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(367): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390682940/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-15 03:11:37,182 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(367): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390682940/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-15 03:11:37,191 INFO [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-15 03:11:37,192 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-15 03:11:37,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-15 03:11:37,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-15 03:11:37,198 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390697198"}]},"ts":"1689390697198"} 2023-07-15 03:11:37,199 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-15 03:11:37,201 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-15 03:11:37,202 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9f140346c421510833ef03f0a2248555, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a2b342b1804c2f6cb41a2c4fc0fff9e8, UNASSIGN}] 2023-07-15 03:11:37,205 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a2b342b1804c2f6cb41a2c4fc0fff9e8, UNASSIGN 2023-07-15 03:11:37,206 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9f140346c421510833ef03f0a2248555, UNASSIGN 2023-07-15 03:11:37,206 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=a2b342b1804c2f6cb41a2c4fc0fff9e8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:37,207 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689390681265.a2b342b1804c2f6cb41a2c4fc0fff9e8.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689390697206"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390697206"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390697206"}]},"ts":"1689390697206"} 2023-07-15 03:11:37,207 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=9f140346c421510833ef03f0a2248555, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:37,207 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689390681265.9f140346c421510833ef03f0a2248555.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689390697207"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390697207"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390697207"}]},"ts":"1689390697207"} 2023-07-15 03:11:37,208 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure a2b342b1804c2f6cb41a2c4fc0fff9e8, server=jenkins-hbase4.apache.org,37439,1689390651159}] 2023-07-15 03:11:37,210 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 9f140346c421510833ef03f0a2248555, server=jenkins-hbase4.apache.org,40245,1689390651089}] 2023-07-15 03:11:37,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-15 03:11:37,362 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a2b342b1804c2f6cb41a2c4fc0fff9e8 2023-07-15 03:11:37,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a2b342b1804c2f6cb41a2c4fc0fff9e8, disabling compactions & flushes 2023-07-15 03:11:37,362 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689390681265.a2b342b1804c2f6cb41a2c4fc0fff9e8. 2023-07-15 03:11:37,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689390681265.a2b342b1804c2f6cb41a2c4fc0fff9e8. 2023-07-15 03:11:37,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689390681265.a2b342b1804c2f6cb41a2c4fc0fff9e8. after waiting 0 ms 2023-07-15 03:11:37,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689390681265.a2b342b1804c2f6cb41a2c4fc0fff9e8. 2023-07-15 03:11:37,366 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9f140346c421510833ef03f0a2248555 2023-07-15 03:11:37,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9f140346c421510833ef03f0a2248555, disabling compactions & flushes 2023-07-15 03:11:37,367 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689390681265.9f140346c421510833ef03f0a2248555. 2023-07-15 03:11:37,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689390681265.9f140346c421510833ef03f0a2248555. 2023-07-15 03:11:37,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689390681265.9f140346c421510833ef03f0a2248555. after waiting 0 ms 2023-07-15 03:11:37,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689390681265.9f140346c421510833ef03f0a2248555. 2023-07-15 03:11:37,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemState/a2b342b1804c2f6cb41a2c4fc0fff9e8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 03:11:37,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemState/9f140346c421510833ef03f0a2248555/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 03:11:37,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:11:37,380 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689390681265.a2b342b1804c2f6cb41a2c4fc0fff9e8. 2023-07-15 03:11:37,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a2b342b1804c2f6cb41a2c4fc0fff9e8: 2023-07-15 03:11:37,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:11:37,381 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689390681265.9f140346c421510833ef03f0a2248555. 2023-07-15 03:11:37,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9f140346c421510833ef03f0a2248555: 2023-07-15 03:11:37,383 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a2b342b1804c2f6cb41a2c4fc0fff9e8 2023-07-15 03:11:37,383 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=a2b342b1804c2f6cb41a2c4fc0fff9e8, regionState=CLOSED 2023-07-15 03:11:37,384 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689390681265.a2b342b1804c2f6cb41a2c4fc0fff9e8.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689390697383"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390697383"}]},"ts":"1689390697383"} 2023-07-15 03:11:37,384 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9f140346c421510833ef03f0a2248555 2023-07-15 03:11:37,386 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=9f140346c421510833ef03f0a2248555, regionState=CLOSED 2023-07-15 03:11:37,386 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689390681265.9f140346c421510833ef03f0a2248555.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689390697386"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390697386"}]},"ts":"1689390697386"} 2023-07-15 03:11:37,393 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-15 03:11:37,393 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure a2b342b1804c2f6cb41a2c4fc0fff9e8, server=jenkins-hbase4.apache.org,37439,1689390651159 in 179 msec 2023-07-15 03:11:37,394 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-15 03:11:37,394 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 9f140346c421510833ef03f0a2248555, server=jenkins-hbase4.apache.org,40245,1689390651089 in 178 msec 2023-07-15 03:11:37,399 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a2b342b1804c2f6cb41a2c4fc0fff9e8, UNASSIGN in 191 msec 2023-07-15 03:11:37,401 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-15 03:11:37,401 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9f140346c421510833ef03f0a2248555, UNASSIGN in 192 msec 2023-07-15 03:11:37,402 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390697401"}]},"ts":"1689390697401"} 2023-07-15 03:11:37,403 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-15 03:11:37,405 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-15 03:11:37,407 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 214 msec 2023-07-15 03:11:37,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-15 03:11:37,500 INFO [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-15 03:11:37,501 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-15 03:11:37,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 03:11:37,505 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 03:11:37,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-15 03:11:37,506 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 03:11:37,507 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43379] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-15 03:11:37,510 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemState/9f140346c421510833ef03f0a2248555 2023-07-15 03:11:37,510 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemState/a2b342b1804c2f6cb41a2c4fc0fff9e8 2023-07-15 03:11:37,511 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 03:11:37,511 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 03:11:37,511 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 03:11:37,511 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 03:11:37,512 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-15 03:11:37,512 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-15 03:11:37,512 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-15 03:11:37,512 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-15 03:11:37,512 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 03:11:37,512 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 03:11:37,513 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:11:37,513 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:11:37,513 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 03:11:37,512 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 03:11:37,513 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:11:37,513 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemState/9f140346c421510833ef03f0a2248555/cf, FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemState/9f140346c421510833ef03f0a2248555/recovered.edits] 2023-07-15 03:11:37,513 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:11:37,513 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemState/a2b342b1804c2f6cb41a2c4fc0fff9e8/cf, FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemState/a2b342b1804c2f6cb41a2c4fc0fff9e8/recovered.edits] 2023-07-15 03:11:37,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-15 03:11:37,518 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemState/9f140346c421510833ef03f0a2248555/cf/a6482998e9534d1793a86f3565cc2d41 to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/archive/data/default/testtb-testExportFileSystemState/9f140346c421510833ef03f0a2248555/cf/a6482998e9534d1793a86f3565cc2d41 2023-07-15 03:11:37,518 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemState/a2b342b1804c2f6cb41a2c4fc0fff9e8/cf/a8d1975a3d7940ba918b8a902d0089f0 to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/archive/data/default/testtb-testExportFileSystemState/a2b342b1804c2f6cb41a2c4fc0fff9e8/cf/a8d1975a3d7940ba918b8a902d0089f0 2023-07-15 03:11:37,521 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemState/9f140346c421510833ef03f0a2248555/recovered.edits/9.seqid to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/archive/data/default/testtb-testExportFileSystemState/9f140346c421510833ef03f0a2248555/recovered.edits/9.seqid 2023-07-15 03:11:37,521 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemState/a2b342b1804c2f6cb41a2c4fc0fff9e8/recovered.edits/9.seqid to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/archive/data/default/testtb-testExportFileSystemState/a2b342b1804c2f6cb41a2c4fc0fff9e8/recovered.edits/9.seqid 2023-07-15 03:11:37,522 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemState/9f140346c421510833ef03f0a2248555 2023-07-15 03:11:37,522 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemState/a2b342b1804c2f6cb41a2c4fc0fff9e8 2023-07-15 03:11:37,522 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-15 03:11:37,522 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-15 03:11:37,523 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-15 03:11:37,527 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230715e2c115a8f5584153863c7c782b73fd24 to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230715e2c115a8f5584153863c7c782b73fd24 2023-07-15 03:11:37,528 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230715d4cda46682674305abc961e79e836458 to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230715d4cda46682674305abc961e79e836458 2023-07-15 03:11:37,529 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-15 03:11:37,531 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 03:11:37,534 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-15 03:11:37,536 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-15 03:11:37,538 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 03:11:37,538 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-15 03:11:37,538 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689390681265.9f140346c421510833ef03f0a2248555.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689390697538"}]},"ts":"9223372036854775807"} 2023-07-15 03:11:37,538 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689390681265.a2b342b1804c2f6cb41a2c4fc0fff9e8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689390697538"}]},"ts":"9223372036854775807"} 2023-07-15 03:11:37,540 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 03:11:37,540 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9f140346c421510833ef03f0a2248555, NAME => 'testtb-testExportFileSystemState,,1689390681265.9f140346c421510833ef03f0a2248555.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a2b342b1804c2f6cb41a2c4fc0fff9e8, NAME => 'testtb-testExportFileSystemState,1,1689390681265.a2b342b1804c2f6cb41a2c4fc0fff9e8.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 03:11:37,540 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-15 03:11:37,541 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689390697540"}]},"ts":"9223372036854775807"} 2023-07-15 03:11:37,542 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-15 03:11:37,544 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 03:11:37,546 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 43 msec 2023-07-15 03:11:37,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-15 03:11:37,615 INFO [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-15 03:11:37,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-15 03:11:37,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-15 03:11:37,626 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-15 03:11:37,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-15 03:11:37,655 INFO [Listener at jenkins-hbase4.apache.org/35095] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=764 (was 749) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_323434787_1 at /127.0.0.1:51134 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_323434787_1 at /127.0.0.1:37356 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_351679589_17 at /127.0.0.1:51578 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1575588394) connection to jenkins-hbase4.apache.org/172.31.14.131:45071 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2eee99d1-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2eee99d1-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2eee99d1-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_351679589_17 at /127.0.0.1:51176 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2eee99d1-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_351679589_17 at /127.0.0.1:37382 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2147 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=926 (was 931), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=394 (was 382) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 180) - ProcessCount LEAK? -, AvailableMemoryMB=2418 (was 2471) 2023-07-15 03:11:37,655 WARN [Listener at jenkins-hbase4.apache.org/35095] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-15 03:11:37,675 INFO [Listener at jenkins-hbase4.apache.org/35095] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=764, OpenFileDescriptor=926, MaxFileDescriptor=60000, SystemLoadAverage=394, ProcessCount=181, AvailableMemoryMB=2417 2023-07-15 03:11:37,675 WARN [Listener at jenkins-hbase4.apache.org/35095] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-15 03:11:37,677 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-15 03:11:37,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-15 03:11:37,680 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 03:11:37,681 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-15 03:11:37,681 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 03:11:37,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-15 03:11:37,684 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testConsecutiveExports/98f7e39d5bcc49a04cb517441d5bbd1d 2023-07-15 03:11:37,684 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testConsecutiveExports/5face6e79a648df4d9e7791b7870bccc 2023-07-15 03:11:37,684 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testConsecutiveExports/98f7e39d5bcc49a04cb517441d5bbd1d empty. 2023-07-15 03:11:37,684 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testConsecutiveExports/5face6e79a648df4d9e7791b7870bccc empty. 2023-07-15 03:11:37,685 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testConsecutiveExports/98f7e39d5bcc49a04cb517441d5bbd1d 2023-07-15 03:11:37,685 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testConsecutiveExports/5face6e79a648df4d9e7791b7870bccc 2023-07-15 03:11:37,685 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-15 03:11:37,697 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-15 03:11:37,699 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 98f7e39d5bcc49a04cb517441d5bbd1d, NAME => 'testtb-testConsecutiveExports,,1689390697676.98f7e39d5bcc49a04cb517441d5bbd1d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp 2023-07-15 03:11:37,699 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 5face6e79a648df4d9e7791b7870bccc, NAME => 'testtb-testConsecutiveExports,1,1689390697676.5face6e79a648df4d9e7791b7870bccc.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp 2023-07-15 03:11:37,719 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689390697676.98f7e39d5bcc49a04cb517441d5bbd1d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:11:37,719 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689390697676.5face6e79a648df4d9e7791b7870bccc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:11:37,719 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 98f7e39d5bcc49a04cb517441d5bbd1d, disabling compactions & flushes 2023-07-15 03:11:37,719 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 5face6e79a648df4d9e7791b7870bccc, disabling compactions & flushes 2023-07-15 03:11:37,719 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689390697676.98f7e39d5bcc49a04cb517441d5bbd1d. 2023-07-15 03:11:37,719 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689390697676.98f7e39d5bcc49a04cb517441d5bbd1d. 2023-07-15 03:11:37,719 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689390697676.5face6e79a648df4d9e7791b7870bccc. 2023-07-15 03:11:37,719 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689390697676.98f7e39d5bcc49a04cb517441d5bbd1d. after waiting 0 ms 2023-07-15 03:11:37,719 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689390697676.5face6e79a648df4d9e7791b7870bccc. 2023-07-15 03:11:37,719 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689390697676.98f7e39d5bcc49a04cb517441d5bbd1d. 2023-07-15 03:11:37,719 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689390697676.5face6e79a648df4d9e7791b7870bccc. after waiting 0 ms 2023-07-15 03:11:37,719 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689390697676.98f7e39d5bcc49a04cb517441d5bbd1d. 2023-07-15 03:11:37,719 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689390697676.5face6e79a648df4d9e7791b7870bccc. 2023-07-15 03:11:37,719 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 98f7e39d5bcc49a04cb517441d5bbd1d: 2023-07-15 03:11:37,719 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689390697676.5face6e79a648df4d9e7791b7870bccc. 2023-07-15 03:11:37,720 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 5face6e79a648df4d9e7791b7870bccc: 2023-07-15 03:11:37,722 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 03:11:37,723 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689390697676.98f7e39d5bcc49a04cb517441d5bbd1d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689390697723"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390697723"}]},"ts":"1689390697723"} 2023-07-15 03:11:37,723 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689390697676.5face6e79a648df4d9e7791b7870bccc.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689390697723"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390697723"}]},"ts":"1689390697723"} 2023-07-15 03:11:37,725 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 03:11:37,726 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 03:11:37,726 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390697726"}]},"ts":"1689390697726"} 2023-07-15 03:11:37,728 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-15 03:11:37,731 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 03:11:37,733 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 03:11:37,733 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 03:11:37,733 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 03:11:37,733 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 03:11:37,733 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=98f7e39d5bcc49a04cb517441d5bbd1d, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5face6e79a648df4d9e7791b7870bccc, ASSIGN}] 2023-07-15 03:11:37,736 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5face6e79a648df4d9e7791b7870bccc, ASSIGN 2023-07-15 03:11:37,736 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=98f7e39d5bcc49a04cb517441d5bbd1d, ASSIGN 2023-07-15 03:11:37,737 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5face6e79a648df4d9e7791b7870bccc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40245,1689390651089; forceNewPlan=false, retain=false 2023-07-15 03:11:37,737 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=98f7e39d5bcc49a04cb517441d5bbd1d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37439,1689390651159; forceNewPlan=false, retain=false 2023-07-15 03:11:37,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-15 03:11:37,887 INFO [jenkins-hbase4:45731] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 03:11:37,889 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=5face6e79a648df4d9e7791b7870bccc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:37,889 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=98f7e39d5bcc49a04cb517441d5bbd1d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:37,889 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689390697676.5face6e79a648df4d9e7791b7870bccc.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689390697889"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390697889"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390697889"}]},"ts":"1689390697889"} 2023-07-15 03:11:37,889 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689390697676.98f7e39d5bcc49a04cb517441d5bbd1d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689390697889"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390697889"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390697889"}]},"ts":"1689390697889"} 2023-07-15 03:11:37,892 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 5face6e79a648df4d9e7791b7870bccc, server=jenkins-hbase4.apache.org,40245,1689390651089}] 2023-07-15 03:11:37,892 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 98f7e39d5bcc49a04cb517441d5bbd1d, server=jenkins-hbase4.apache.org,37439,1689390651159}] 2023-07-15 03:11:37,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-15 03:11:38,047 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689390697676.5face6e79a648df4d9e7791b7870bccc. 2023-07-15 03:11:38,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5face6e79a648df4d9e7791b7870bccc, NAME => 'testtb-testConsecutiveExports,1,1689390697676.5face6e79a648df4d9e7791b7870bccc.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 03:11:38,047 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689390697676.98f7e39d5bcc49a04cb517441d5bbd1d. 2023-07-15 03:11:38,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 98f7e39d5bcc49a04cb517441d5bbd1d, NAME => 'testtb-testConsecutiveExports,,1689390697676.98f7e39d5bcc49a04cb517441d5bbd1d.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 03:11:38,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689390697676.5face6e79a648df4d9e7791b7870bccc. service=AccessControlService 2023-07-15 03:11:38,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689390697676.98f7e39d5bcc49a04cb517441d5bbd1d. service=AccessControlService 2023-07-15 03:11:38,048 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 03:11:38,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 5face6e79a648df4d9e7791b7870bccc 2023-07-15 03:11:38,048 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 03:11:38,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689390697676.5face6e79a648df4d9e7791b7870bccc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:11:38,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5face6e79a648df4d9e7791b7870bccc 2023-07-15 03:11:38,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5face6e79a648df4d9e7791b7870bccc 2023-07-15 03:11:38,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 98f7e39d5bcc49a04cb517441d5bbd1d 2023-07-15 03:11:38,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689390697676.98f7e39d5bcc49a04cb517441d5bbd1d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:11:38,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 98f7e39d5bcc49a04cb517441d5bbd1d 2023-07-15 03:11:38,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 98f7e39d5bcc49a04cb517441d5bbd1d 2023-07-15 03:11:38,049 INFO [StoreOpener-5face6e79a648df4d9e7791b7870bccc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5face6e79a648df4d9e7791b7870bccc 2023-07-15 03:11:38,050 INFO [StoreOpener-98f7e39d5bcc49a04cb517441d5bbd1d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 98f7e39d5bcc49a04cb517441d5bbd1d 2023-07-15 03:11:38,051 DEBUG [StoreOpener-5face6e79a648df4d9e7791b7870bccc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testConsecutiveExports/5face6e79a648df4d9e7791b7870bccc/cf 2023-07-15 03:11:38,051 DEBUG [StoreOpener-5face6e79a648df4d9e7791b7870bccc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testConsecutiveExports/5face6e79a648df4d9e7791b7870bccc/cf 2023-07-15 03:11:38,051 DEBUG [StoreOpener-98f7e39d5bcc49a04cb517441d5bbd1d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testConsecutiveExports/98f7e39d5bcc49a04cb517441d5bbd1d/cf 2023-07-15 03:11:38,051 DEBUG [StoreOpener-98f7e39d5bcc49a04cb517441d5bbd1d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testConsecutiveExports/98f7e39d5bcc49a04cb517441d5bbd1d/cf 2023-07-15 03:11:38,051 INFO [StoreOpener-5face6e79a648df4d9e7791b7870bccc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5face6e79a648df4d9e7791b7870bccc columnFamilyName cf 2023-07-15 03:11:38,051 INFO [StoreOpener-98f7e39d5bcc49a04cb517441d5bbd1d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 98f7e39d5bcc49a04cb517441d5bbd1d columnFamilyName cf 2023-07-15 03:11:38,053 INFO [StoreOpener-98f7e39d5bcc49a04cb517441d5bbd1d-1] regionserver.HStore(310): Store=98f7e39d5bcc49a04cb517441d5bbd1d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:11:38,053 INFO [StoreOpener-5face6e79a648df4d9e7791b7870bccc-1] regionserver.HStore(310): Store=5face6e79a648df4d9e7791b7870bccc/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:11:38,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testConsecutiveExports/98f7e39d5bcc49a04cb517441d5bbd1d 2023-07-15 03:11:38,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testConsecutiveExports/5face6e79a648df4d9e7791b7870bccc 2023-07-15 03:11:38,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testConsecutiveExports/98f7e39d5bcc49a04cb517441d5bbd1d 2023-07-15 03:11:38,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testConsecutiveExports/5face6e79a648df4d9e7791b7870bccc 2023-07-15 03:11:38,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 98f7e39d5bcc49a04cb517441d5bbd1d 2023-07-15 03:11:38,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5face6e79a648df4d9e7791b7870bccc 2023-07-15 03:11:38,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testConsecutiveExports/5face6e79a648df4d9e7791b7870bccc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 03:11:38,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testConsecutiveExports/98f7e39d5bcc49a04cb517441d5bbd1d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 03:11:38,059 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5face6e79a648df4d9e7791b7870bccc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68129624, jitterRate=0.015210509300231934}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 03:11:38,059 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 98f7e39d5bcc49a04cb517441d5bbd1d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64712948, jitterRate=-0.0357019305229187}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 03:11:38,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5face6e79a648df4d9e7791b7870bccc: 2023-07-15 03:11:38,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 98f7e39d5bcc49a04cb517441d5bbd1d: 2023-07-15 03:11:38,060 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689390697676.98f7e39d5bcc49a04cb517441d5bbd1d., pid=46, masterSystemTime=1689390698044 2023-07-15 03:11:38,061 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689390697676.5face6e79a648df4d9e7791b7870bccc., pid=45, masterSystemTime=1689390698044 2023-07-15 03:11:38,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689390697676.98f7e39d5bcc49a04cb517441d5bbd1d. 2023-07-15 03:11:38,063 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689390697676.98f7e39d5bcc49a04cb517441d5bbd1d. 2023-07-15 03:11:38,064 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=98f7e39d5bcc49a04cb517441d5bbd1d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:38,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689390697676.5face6e79a648df4d9e7791b7870bccc. 2023-07-15 03:11:38,064 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689390697676.98f7e39d5bcc49a04cb517441d5bbd1d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689390698064"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689390698064"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689390698064"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689390698064"}]},"ts":"1689390698064"} 2023-07-15 03:11:38,064 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689390697676.5face6e79a648df4d9e7791b7870bccc. 2023-07-15 03:11:38,065 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=5face6e79a648df4d9e7791b7870bccc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:38,065 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689390697676.5face6e79a648df4d9e7791b7870bccc.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689390698065"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689390698065"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689390698065"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689390698065"}]},"ts":"1689390698065"} 2023-07-15 03:11:38,069 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-15 03:11:38,070 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 98f7e39d5bcc49a04cb517441d5bbd1d, server=jenkins-hbase4.apache.org,37439,1689390651159 in 174 msec 2023-07-15 03:11:38,070 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-15 03:11:38,071 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 5face6e79a648df4d9e7791b7870bccc, server=jenkins-hbase4.apache.org,40245,1689390651089 in 176 msec 2023-07-15 03:11:38,071 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=98f7e39d5bcc49a04cb517441d5bbd1d, ASSIGN in 337 msec 2023-07-15 03:11:38,073 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-15 03:11:38,073 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5face6e79a648df4d9e7791b7870bccc, ASSIGN in 338 msec 2023-07-15 03:11:38,074 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 03:11:38,074 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390698074"}]},"ts":"1689390698074"} 2023-07-15 03:11:38,075 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-15 03:11:38,078 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 03:11:38,078 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-15 03:11:38,084 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43379] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-15 03:11:38,085 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:11:38,085 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:11:38,085 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:11:38,085 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:11:38,087 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-15 03:11:38,087 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-15 03:11:38,087 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-15 03:11:38,088 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-15 03:11:38,089 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 410 msec 2023-07-15 03:11:38,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-15 03:11:38,285 INFO [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-15 03:11:38,288 DEBUG [Listener at jenkins-hbase4.apache.org/35095] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-15 03:11:38,288 DEBUG [Listener at jenkins-hbase4.apache.org/35095] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689390697676.98f7e39d5bcc49a04cb517441d5bbd1d. 2023-07-15 03:11:38,291 INFO [Listener at jenkins-hbase4.apache.org/35095] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 03:11:38,302 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 03:11:38,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689390698302 (current time:1689390698302). 2023-07-15 03:11:38,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 03:11:38,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(139): Connect 0x109ac492 to 127.0.0.1:58749 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:11:38,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@435dad0e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:11:38,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:11:38,314 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57666, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:11:38,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x109ac492 to 127.0.0.1:58749 2023-07-15 03:11:38,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:11:38,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(139): Connect 0x4b7400a7 to 127.0.0.1:58749 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:11:38,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d0ce30f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:11:38,322 DEBUG [hconnection-0x23971a7d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:11:38,325 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57674, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:11:38,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:11:38,331 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45328, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:11:38,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4b7400a7 to 127.0.0.1:58749 2023-07-15 03:11:38,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:11:38,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-15 03:11:38,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 03:11:38,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 03:11:38,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 03:11:38,337 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 03:11:38,337 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689391298337 2023-07-15 03:11:38,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 03:11:38,337 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-15 03:11:38,339 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 03:11:38,339 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 03:11:38,340 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 03:11:38,341 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 03:11:38,342 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-07-15 03:11:38,343 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 03:11:38,344 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689391298344 2023-07-15 03:11:38,359 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,359 INFO [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-15 03:11:38,359 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:38,361 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-15 03:11:38,361 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-15 03:11:38,361 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,361 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,362 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:38,362 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:38,362 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:38,362 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:38,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:38,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:38,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:38,363 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:38,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:38,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:38,363 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:38,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:38,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,363 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:38,363 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 03:11:38,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,364 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,364 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,364 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-15 03:11:38,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,364 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 03:11:38,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-15 03:11:38,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-15 03:11:38,364 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,365 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 03:11:38,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,365 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:38,365 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 03:11:38,366 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 03:11:38,365 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 03:11:38,366 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-15 03:11:38,366 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37439,1689390651159' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-15 03:11:38,366 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,366 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,367 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 03:11:38,366 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 03:11:38,367 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:38,367 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:38,368 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 03:11:38,371 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-15 03:11:38,371 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 03:11:38,371 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-15 03:11:38,371 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40245,1689390651089' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-15 03:11:38,371 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43379,1689390651212' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-15 03:11:38,372 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:38,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:38,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:38,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:38,372 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,373 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:38,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:38,373 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,373 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:11:38,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:38,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:38,375 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:38,379 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,379 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,379 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:11:38,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:38,379 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,379 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:11:38,379 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37439,1689390651159' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-15 03:11:38,379 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@16fe930a[Count = 1] remaining members to acquire global barrier 2023-07-15 03:11:38,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:38,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:38,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:38,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:38,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:38,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:38,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:38,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:38,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:38,382 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40245,1689390651089' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-15 03:11:38,382 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@16fe930a[Count = 0] remaining members to acquire global barrier 2023-07-15 03:11:38,382 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-15 03:11:38,382 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,383 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,383 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,383 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,383 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 03:11:38,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,383 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:38,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,383 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-15 03:11:38,384 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 03:11:38,384 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43379,1689390651212' in zk 2023-07-15 03:11:38,384 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:38,384 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 03:11:38,384 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 03:11:38,384 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:11:38,384 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:11:38,384 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689390697676.5face6e79a648df4d9e7791b7870bccc. 2023-07-15 03:11:38,384 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:11:38,384 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689390697676.98f7e39d5bcc49a04cb517441d5bbd1d. 2023-07-15 03:11:38,384 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689390697676.5face6e79a648df4d9e7791b7870bccc. started... 2023-07-15 03:11:38,384 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689390697676.98f7e39d5bcc49a04cb517441d5bbd1d. started... 2023-07-15 03:11:38,384 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:11:38,386 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5face6e79a648df4d9e7791b7870bccc: 2023-07-15 03:11:38,386 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 98f7e39d5bcc49a04cb517441d5bbd1d: 2023-07-15 03:11:38,386 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689390697676.5face6e79a648df4d9e7791b7870bccc.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,386 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:11:38,386 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 03:11:38,386 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689390697676.98f7e39d5bcc49a04cb517441d5bbd1d.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,386 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:11:38,386 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 03:11:38,389 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 03:11:38,389 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:38,389 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-15 03:11:38,407 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689390697676.98f7e39d5bcc49a04cb517441d5bbd1d. completed. 2023-07-15 03:11:38,407 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689390697676.5face6e79a648df4d9e7791b7870bccc. completed. 2023-07-15 03:11:38,407 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689390697676.98f7e39d5bcc49a04cb517441d5bbd1d. 2023-07-15 03:11:38,407 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689390697676.5face6e79a648df4d9e7791b7870bccc. 2023-07-15 03:11:38,407 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:11:38,408 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:11:38,408 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:11:38,408 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:11:38,408 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:38,408 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:38,408 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-15 03:11:38,408 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-15 03:11:38,408 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40245,1689390651089' in zk 2023-07-15 03:11:38,408 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37439,1689390651159' in zk 2023-07-15 03:11:38,410 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 03:11:38,410 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:38,410 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:38,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:38,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:38,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:38,410 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 03:11:38,411 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-15 03:11:38,410 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:38,412 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:38,412 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-15 03:11:38,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:38,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:38,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:38,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:38,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:38,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:38,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:38,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:38,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:38,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37439,1689390651159': 2023-07-15 03:11:38,419 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37439,1689390651159' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-15 03:11:38,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:38,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:38,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:38,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:38,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:38,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:38,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:38,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:38,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:38,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:38,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:38,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:38,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,40245,1689390651089': 2023-07-15 03:11:38,424 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40245,1689390651089' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-15 03:11:38,424 INFO [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-15 03:11:38,424 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 03:11:38,424 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 03:11:38,424 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,424 INFO [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 03:11:38,426 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,426 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,426 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,426 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:38,426 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:38,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,426 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,426 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:38,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:38,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:38,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:38,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:38,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:38,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:38,427 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:38,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:38,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:38,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:38,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,428 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:38,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,429 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:38,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:38,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:38,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:38,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:38,431 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:38,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:38,431 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:38,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,432 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:38,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:38,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:38,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:38,435 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:38,435 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:38,435 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:38,436 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:38,436 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:38,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:38,435 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:38,436 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,436 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-15 03:11:38,436 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:38,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:38,436 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 03:11:38,435 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:38,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:38,437 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-15 03:11:38,436 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:38,436 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:38,436 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:38,439 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,439 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:38,439 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,439 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:38,439 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:38,439 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,439 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:38,437 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:38,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:38,439 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:11:38,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:38,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:38,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:38,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:38,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:38,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-15 03:11:38,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-15 03:11:38,441 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 03:11:38,461 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,462 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,480 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,498 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-15 03:11:38,498 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,499 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-15 03:11:38,499 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689390698338Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689390698461 (+123 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689390698461Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689390698461Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689390698465 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689390698475 (+10 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689390698498 (+23 ms) 2023-07-15 03:11:38,507 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 03:11:38,509 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 168 msec 2023-07-15 03:11:38,642 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:11:38,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-15 03:11:38,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 03:11:38,647 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37439] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689390697676.98f7e39d5bcc49a04cb517441d5bbd1d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 03:11:38,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40245] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689390697676.5face6e79a648df4d9e7791b7870bccc. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 03:11:38,652 DEBUG [Listener at jenkins-hbase4.apache.org/35095] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-15 03:11:38,652 DEBUG [Listener at jenkins-hbase4.apache.org/35095] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689390697676.98f7e39d5bcc49a04cb517441d5bbd1d. 2023-07-15 03:11:38,652 INFO [Listener at jenkins-hbase4.apache.org/35095] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 03:11:38,663 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 03:11:38,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689390698664 (current time:1689390698664). 2023-07-15 03:11:38,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 03:11:38,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(139): Connect 0x370b8967 to 127.0.0.1:58749 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:11:38,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24e60bce, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:11:38,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:11:38,682 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57690, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:11:38,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x370b8967 to 127.0.0.1:58749 2023-07-15 03:11:38,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:11:38,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(139): Connect 0x426d69a6 to 127.0.0.1:58749 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:11:38,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2946903d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:11:38,692 DEBUG [hconnection-0x3dea56a0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:11:38,695 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57706, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:11:38,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:11:38,701 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45334, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:11:38,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x426d69a6 to 127.0.0.1:58749 2023-07-15 03:11:38,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:11:38,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-15 03:11:38,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 03:11:38,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 03:11:38,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 03:11:38,708 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 03:11:38,709 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689391298709 2023-07-15 03:11:38,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 03:11:38,709 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-15 03:11:38,712 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 03:11:38,712 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 03:11:38,713 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 03:11:38,713 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 03:11:38,715 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 9 msec 2023-07-15 03:11:38,716 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 03:11:38,716 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689391298716 2023-07-15 03:11:38,731 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-15 03:11:38,731 INFO [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-15 03:11:38,731 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:38,732 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-15 03:11:38,732 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-15 03:11:38,733 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,733 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,735 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:38,735 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:38,735 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:38,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:38,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:38,735 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:38,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:38,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:38,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:38,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:38,736 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:38,736 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:38,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,738 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:38,738 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 03:11:38,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,738 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,738 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-15 03:11:38,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-15 03:11:38,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,739 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 03:11:38,739 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 03:11:38,739 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-15 03:11:38,739 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-15 03:11:38,739 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 03:11:38,739 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 03:11:38,739 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:38,739 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:38,741 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 03:11:38,742 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 03:11:38,742 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-15 03:11:38,742 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40245,1689390651089' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-15 03:11:38,742 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-15 03:11:38,742 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37439,1689390651159' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-15 03:11:38,743 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,743 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:38,743 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:38,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:38,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:38,744 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:38,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-15 03:11:38,744 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:38,744 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,744 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:11:38,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,745 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 03:11:38,745 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,745 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:11:38,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:38,745 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-15 03:11:38,745 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 03:11:38,745 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:11:38,746 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 03:11:38,746 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-15 03:11:38,746 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43379,1689390651212' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-15 03:11:38,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 03:11:38,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:38,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:38,749 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,749 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,749 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:11:38,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:38,751 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40245,1689390651089' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-15 03:11:38,751 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41b1b66c[Count = 1] remaining members to acquire global barrier 2023-07-15 03:11:38,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:38,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:38,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:38,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:38,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:38,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 03:11:38,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:38,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:38,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:38,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:38,754 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37439,1689390651159' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-15 03:11:38,754 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41b1b66c[Count = 0] remaining members to acquire global barrier 2023-07-15 03:11:38,754 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-15 03:11:38,754 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,757 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,757 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,758 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 03:11:38,758 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-15 03:11:38,757 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,758 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43379,1689390651212' in zk 2023-07-15 03:11:38,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,758 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:38,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,758 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 03:11:38,758 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 03:11:38,758 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:38,758 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 03:11:38,760 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 03:11:38,760 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:38,760 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-15 03:11:38,766 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:11:38,766 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:11:38,767 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:11:38,767 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689390697676.5face6e79a648df4d9e7791b7870bccc. 2023-07-15 03:11:38,767 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689390697676.98f7e39d5bcc49a04cb517441d5bbd1d. 2023-07-15 03:11:38,767 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689390697676.5face6e79a648df4d9e7791b7870bccc. started... 2023-07-15 03:11:38,767 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689390697676.98f7e39d5bcc49a04cb517441d5bbd1d. started... 2023-07-15 03:11:38,766 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:11:38,767 INFO [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 98f7e39d5bcc49a04cb517441d5bbd1d 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-15 03:11:38,767 INFO [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5face6e79a648df4d9e7791b7870bccc 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-15 03:11:38,805 INFO [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071599eb4df9de534cd08d892938053b12f1 to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071599eb4df9de534cd08d892938053b12f1 2023-07-15 03:11:38,808 INFO [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307155d432e29dff34cf0b7d96c37864dd58f to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307155d432e29dff34cf0b7d96c37864dd58f 2023-07-15 03:11:38,812 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:11:38,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-15 03:11:38,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-15 03:11:38,814 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 03:11:38,815 INFO [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testConsecutiveExports/5face6e79a648df4d9e7791b7870bccc/.tmp/cf/5c546408f9434d44bb708118b093a96e 2023-07-15 03:11:38,820 INFO [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testConsecutiveExports/98f7e39d5bcc49a04cb517441d5bbd1d/.tmp/cf/2055e112bf1c4988a0b59d25dcf589a1 2023-07-15 03:11:38,821 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testConsecutiveExports/5face6e79a648df4d9e7791b7870bccc/.tmp/cf/5c546408f9434d44bb708118b093a96e as hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testConsecutiveExports/5face6e79a648df4d9e7791b7870bccc/cf/5c546408f9434d44bb708118b093a96e 2023-07-15 03:11:38,826 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testConsecutiveExports/98f7e39d5bcc49a04cb517441d5bbd1d/.tmp/cf/2055e112bf1c4988a0b59d25dcf589a1 as hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testConsecutiveExports/98f7e39d5bcc49a04cb517441d5bbd1d/cf/2055e112bf1c4988a0b59d25dcf589a1 2023-07-15 03:11:38,828 INFO [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testConsecutiveExports/5face6e79a648df4d9e7791b7870bccc/cf/5c546408f9434d44bb708118b093a96e, entries=46, sequenceid=6, filesize=12.5 K 2023-07-15 03:11:38,830 INFO [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 5face6e79a648df4d9e7791b7870bccc in 63ms, sequenceid=6, compaction requested=false 2023-07-15 03:11:38,830 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-15 03:11:38,831 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5face6e79a648df4d9e7791b7870bccc: 2023-07-15 03:11:38,831 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689390697676.5face6e79a648df4d9e7791b7870bccc.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-15 03:11:38,831 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:11:38,831 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testConsecutiveExports/5face6e79a648df4d9e7791b7870bccc/cf/5c546408f9434d44bb708118b093a96e] hfiles 2023-07-15 03:11:38,831 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testConsecutiveExports/5face6e79a648df4d9e7791b7870bccc/cf/5c546408f9434d44bb708118b093a96e for snapshot=snaptb0-testConsecutiveExports 2023-07-15 03:11:38,846 INFO [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testConsecutiveExports/98f7e39d5bcc49a04cb517441d5bbd1d/cf/2055e112bf1c4988a0b59d25dcf589a1, entries=4, sequenceid=6, filesize=5.6 K 2023-07-15 03:11:38,847 INFO [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 98f7e39d5bcc49a04cb517441d5bbd1d in 80ms, sequenceid=6, compaction requested=false 2023-07-15 03:11:38,852 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 98f7e39d5bcc49a04cb517441d5bbd1d: 2023-07-15 03:11:38,853 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689390697676.98f7e39d5bcc49a04cb517441d5bbd1d.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-15 03:11:38,853 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:11:38,853 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testConsecutiveExports/98f7e39d5bcc49a04cb517441d5bbd1d/cf/2055e112bf1c4988a0b59d25dcf589a1] hfiles 2023-07-15 03:11:38,853 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testConsecutiveExports/98f7e39d5bcc49a04cb517441d5bbd1d/cf/2055e112bf1c4988a0b59d25dcf589a1 for snapshot=snaptb0-testConsecutiveExports 2023-07-15 03:11:38,884 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689390697676.5face6e79a648df4d9e7791b7870bccc. completed. 2023-07-15 03:11:38,884 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689390697676.5face6e79a648df4d9e7791b7870bccc. 2023-07-15 03:11:38,884 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:11:38,884 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:11:38,884 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:38,885 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-15 03:11:38,885 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40245,1689390651089' in zk 2023-07-15 03:11:38,887 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:38,887 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 03:11:38,887 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:38,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:38,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:38,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:38,887 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-15 03:11:38,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:38,889 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689390697676.98f7e39d5bcc49a04cb517441d5bbd1d. completed. 2023-07-15 03:11:38,889 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689390697676.98f7e39d5bcc49a04cb517441d5bbd1d. 2023-07-15 03:11:38,890 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:11:38,890 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:11:38,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:38,890 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:38,890 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-15 03:11:38,890 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37439,1689390651159' in zk 2023-07-15 03:11:38,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 03:11:38,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:38,891 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 03:11:38,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:38,891 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:38,891 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-15 03:11:38,893 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:38,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:38,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:38,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 03:11:38,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:38,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:38,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:38,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,40245,1689390651089': 2023-07-15 03:11:38,895 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40245,1689390651089' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-15 03:11:38,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:38,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:38,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:38,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:38,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:38,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 03:11:38,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:38,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:38,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:38,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:38,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 03:11:38,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:38,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:38,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:38,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37439,1689390651159': 2023-07-15 03:11:38,899 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37439,1689390651159' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-15 03:11:38,899 INFO [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-15 03:11:38,899 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 03:11:38,899 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 03:11:38,899 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-15 03:11:38,899 INFO [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 03:11:38,901 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,901 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,901 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:11:38,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:11:38,901 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:38,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,901 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:38,901 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,901 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:38,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:11:38,902 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:38,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:38,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:38,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:38,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:38,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 03:11:38,902 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:38,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:38,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:38,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:11:38,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,903 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:38,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 03:11:38,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:38,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:38,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:38,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:11:38,905 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:38,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 03:11:38,905 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:38,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:38,905 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:38,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:38,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:38,912 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:38,912 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:38,912 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:38,912 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:38,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:38,912 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:38,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:38,913 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:11:38,912 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:38,912 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:11:38,913 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-15 03:11:38,913 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:38,915 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:38,915 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,915 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:11:38,915 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,915 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:11:38,915 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:11:38,915 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,915 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:11:38,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:11:38,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:38,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:38,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:38,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:11:38,915 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,915 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-15 03:11:38,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:38,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:38,916 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-15 03:11:38,916 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 03:11:38,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:11:38,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:11:38,917 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071599eb4df9de534cd08d892938053b12f1, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307155d432e29dff34cf0b7d96c37864dd58f] mob files 2023-07-15 03:11:38,917 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071599eb4df9de534cd08d892938053b12f1 2023-07-15 03:11:38,917 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307155d432e29dff34cf0b7d96c37864dd58f 2023-07-15 03:11:38,936 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-15 03:11:38,937 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,956 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,975 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-15 03:11:38,975 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,976 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 03:11:38,976 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689390698709Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689390698936 (+227 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1689390698936Loading Region manifests for snaptb0-testConsecutiveExports at 1689390698936Writing data manifest for snaptb0-testConsecutiveExports at 1689390698940 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689390698948 (+8 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689390698975 (+27 ms) 2023-07-15 03:11:38,978 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 03:11:38,980 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 268 msec 2023-07-15 03:11:39,014 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:11:39,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-15 03:11:39,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 03:11:39,016 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/local-export-1689390699016 2023-07-15 03:11:39,016 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/local-export-1689390699016, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/local-export-1689390699016, srcFsUri=hdfs://localhost:33795, srcDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d 2023-07-15 03:11:39,040 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33795, inputRoot=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d 2023-07-15 03:11:39,040 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@5f527e37, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/local-export-1689390699016, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/local-export-1689390699016/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,040 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33795, inputRoot=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d, snapshotDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-15 03:11:39,048 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/local-export-1689390699016/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 03:11:39,060 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:39,061 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:39,061 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:39,061 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:40,023 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/hadoop-2815620909514550256.jar 2023-07-15 03:11:40,024 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:40,024 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:40,094 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/hadoop-1211375716282988014.jar 2023-07-15 03:11:40,094 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:40,095 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:40,095 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:40,096 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:40,096 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:40,097 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:40,097 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 03:11:40,097 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 03:11:40,098 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 03:11:40,098 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 03:11:40,099 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 03:11:40,099 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 03:11:40,100 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 03:11:40,100 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 03:11:40,101 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 03:11:40,101 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 03:11:40,102 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:11:40,103 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:11:40,103 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 03:11:40,103 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:11:40,104 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:11:40,104 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 03:11:40,105 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 03:11:40,924 WARN [Listener at jenkins-hbase4.apache.org/35095] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 03:11:40,926 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-15 03:11:40,928 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-15 03:11:42,083 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 03:11:42,083 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 03:11:42,086 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660272_0002_000001 (auth:SIMPLE) 2023-07-15 03:11:42,461 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660272_0003_000001 (auth:SIMPLE) 2023-07-15 03:11:42,969 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 03:11:46,919 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660272_0003_000001 (auth:SIMPLE) 2023-07-15 03:11:49,177 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660272_0003_000001 (auth:SIMPLE) 2023-07-15 03:11:52,671 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660272_0003_000001 (auth:SIMPLE) 2023-07-15 03:11:54,173 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 03:11:54,173 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 03:11:54,177 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-15 03:11:54,177 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 03:11:54,178 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 03:11:54,178 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_351679589_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-15 03:11:54,179 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(367): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-15 03:11:54,179 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(367): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-15 03:11:54,179 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@25bfc998 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/local-export-1689390699016/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/local-export-1689390699016/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-15 03:11:54,180 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/local-export-1689390699016/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-15 03:11:54,180 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/local-export-1689390699016/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-15 03:11:54,181 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/local-export-1689390699016, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/local-export-1689390699016, srcFsUri=hdfs://localhost:33795, srcDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d 2023-07-15 03:11:54,203 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33795, inputRoot=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d 2023-07-15 03:11:54,203 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@102944b0, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/local-export-1689390699016, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/local-export-1689390699016/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 03:11:54,203 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33795, inputRoot=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d, snapshotDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-15 03:11:54,214 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/local-export-1689390699016/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 03:11:54,226 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:54,226 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:54,227 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:54,227 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:55,122 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/hadoop-656022263499128284.jar 2023-07-15 03:11:55,123 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:55,123 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:55,190 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/hadoop-6221318916023632994.jar 2023-07-15 03:11:55,191 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:55,191 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:55,192 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:55,192 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:55,193 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:55,193 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 03:11:55,194 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 03:11:55,194 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 03:11:55,194 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 03:11:55,195 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 03:11:55,195 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 03:11:55,196 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 03:11:55,196 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 03:11:55,196 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 03:11:55,197 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 03:11:55,197 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 03:11:55,198 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:11:55,198 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:11:55,199 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 03:11:55,199 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:11:55,199 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:11:55,200 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 03:11:55,200 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 03:11:55,647 WARN [Listener at jenkins-hbase4.apache.org/35095] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 03:11:55,650 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-15 03:11:55,653 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-15 03:11:58,850 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 03:11:58,850 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 03:11:58,853 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660272_0003_000001 (auth:SIMPLE) 2023-07-15 03:11:59,563 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660272_0004_000001 (auth:SIMPLE) 2023-07-15 03:12:03,988 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660272_0004_000001 (auth:SIMPLE) 2023-07-15 03:12:06,334 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660272_0004_000001 (auth:SIMPLE) 2023-07-15 03:12:09,360 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660272_0004_000001 (auth:SIMPLE) 2023-07-15 03:12:10,849 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 03:12:10,849 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 03:12:10,853 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-15 03:12:10,854 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 03:12:10,854 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 03:12:10,854 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_351679589_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-15 03:12:10,861 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(367): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-15 03:12:10,861 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(367): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-15 03:12:10,861 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@25bfc998 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/local-export-1689390699016/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/local-export-1689390699016/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-15 03:12:10,862 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/local-export-1689390699016/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-15 03:12:10,862 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/local-export-1689390699016/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-15 03:12:10,880 INFO [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-15 03:12:10,880 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-15 03:12:10,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-15 03:12:10,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-15 03:12:10,887 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390730886"}]},"ts":"1689390730886"} 2023-07-15 03:12:10,888 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-15 03:12:10,890 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-15 03:12:10,891 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=98f7e39d5bcc49a04cb517441d5bbd1d, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5face6e79a648df4d9e7791b7870bccc, UNASSIGN}] 2023-07-15 03:12:10,893 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=98f7e39d5bcc49a04cb517441d5bbd1d, UNASSIGN 2023-07-15 03:12:10,893 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5face6e79a648df4d9e7791b7870bccc, UNASSIGN 2023-07-15 03:12:10,894 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=5face6e79a648df4d9e7791b7870bccc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:10,894 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=98f7e39d5bcc49a04cb517441d5bbd1d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:10,894 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689390697676.98f7e39d5bcc49a04cb517441d5bbd1d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689390730894"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390730894"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390730894"}]},"ts":"1689390730894"} 2023-07-15 03:12:10,894 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689390697676.5face6e79a648df4d9e7791b7870bccc.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689390730894"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390730894"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390730894"}]},"ts":"1689390730894"} 2023-07-15 03:12:10,896 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 5face6e79a648df4d9e7791b7870bccc, server=jenkins-hbase4.apache.org,40245,1689390651089}] 2023-07-15 03:12:10,897 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 98f7e39d5bcc49a04cb517441d5bbd1d, server=jenkins-hbase4.apache.org,37439,1689390651159}] 2023-07-15 03:12:10,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-15 03:12:11,049 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5face6e79a648df4d9e7791b7870bccc 2023-07-15 03:12:11,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5face6e79a648df4d9e7791b7870bccc, disabling compactions & flushes 2023-07-15 03:12:11,049 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689390697676.5face6e79a648df4d9e7791b7870bccc. 2023-07-15 03:12:11,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689390697676.5face6e79a648df4d9e7791b7870bccc. 2023-07-15 03:12:11,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689390697676.5face6e79a648df4d9e7791b7870bccc. after waiting 0 ms 2023-07-15 03:12:11,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689390697676.5face6e79a648df4d9e7791b7870bccc. 2023-07-15 03:12:11,052 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 98f7e39d5bcc49a04cb517441d5bbd1d 2023-07-15 03:12:11,053 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 98f7e39d5bcc49a04cb517441d5bbd1d, disabling compactions & flushes 2023-07-15 03:12:11,053 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689390697676.98f7e39d5bcc49a04cb517441d5bbd1d. 2023-07-15 03:12:11,053 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689390697676.98f7e39d5bcc49a04cb517441d5bbd1d. 2023-07-15 03:12:11,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689390697676.98f7e39d5bcc49a04cb517441d5bbd1d. after waiting 0 ms 2023-07-15 03:12:11,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689390697676.98f7e39d5bcc49a04cb517441d5bbd1d. 2023-07-15 03:12:11,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testConsecutiveExports/5face6e79a648df4d9e7791b7870bccc/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 03:12:11,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:12:11,093 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689390697676.5face6e79a648df4d9e7791b7870bccc. 2023-07-15 03:12:11,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testConsecutiveExports/98f7e39d5bcc49a04cb517441d5bbd1d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 03:12:11,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5face6e79a648df4d9e7791b7870bccc: 2023-07-15 03:12:11,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:12:11,095 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689390697676.98f7e39d5bcc49a04cb517441d5bbd1d. 2023-07-15 03:12:11,095 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 98f7e39d5bcc49a04cb517441d5bbd1d: 2023-07-15 03:12:11,098 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5face6e79a648df4d9e7791b7870bccc 2023-07-15 03:12:11,098 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=5face6e79a648df4d9e7791b7870bccc, regionState=CLOSED 2023-07-15 03:12:11,098 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689390697676.5face6e79a648df4d9e7791b7870bccc.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689390731098"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390731098"}]},"ts":"1689390731098"} 2023-07-15 03:12:11,100 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 98f7e39d5bcc49a04cb517441d5bbd1d 2023-07-15 03:12:11,102 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=98f7e39d5bcc49a04cb517441d5bbd1d, regionState=CLOSED 2023-07-15 03:12:11,102 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689390697676.98f7e39d5bcc49a04cb517441d5bbd1d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689390731102"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390731102"}]},"ts":"1689390731102"} 2023-07-15 03:12:11,107 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-15 03:12:11,107 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 5face6e79a648df4d9e7791b7870bccc, server=jenkins-hbase4.apache.org,40245,1689390651089 in 206 msec 2023-07-15 03:12:11,115 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5face6e79a648df4d9e7791b7870bccc, UNASSIGN in 216 msec 2023-07-15 03:12:11,116 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-15 03:12:11,116 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 98f7e39d5bcc49a04cb517441d5bbd1d, server=jenkins-hbase4.apache.org,37439,1689390651159 in 209 msec 2023-07-15 03:12:11,118 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-15 03:12:11,119 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=98f7e39d5bcc49a04cb517441d5bbd1d, UNASSIGN in 225 msec 2023-07-15 03:12:11,121 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390731121"}]},"ts":"1689390731121"} 2023-07-15 03:12:11,123 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-15 03:12:11,125 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-15 03:12:11,128 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 245 msec 2023-07-15 03:12:11,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-15 03:12:11,188 INFO [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-15 03:12:11,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-15 03:12:11,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 03:12:11,194 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 03:12:11,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-15 03:12:11,197 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 03:12:11,205 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43379] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-15 03:12:11,207 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testConsecutiveExports/98f7e39d5bcc49a04cb517441d5bbd1d 2023-07-15 03:12:11,209 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 03:12:11,209 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 03:12:11,210 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 03:12:11,210 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 03:12:11,210 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-15 03:12:11,210 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-15 03:12:11,211 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-15 03:12:11,211 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-15 03:12:11,211 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 03:12:11,211 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 03:12:11,212 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:11,212 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:11,212 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 03:12:11,212 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:11,212 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 03:12:11,212 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:11,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-15 03:12:11,215 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testConsecutiveExports/5face6e79a648df4d9e7791b7870bccc 2023-07-15 03:12:11,218 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testConsecutiveExports/98f7e39d5bcc49a04cb517441d5bbd1d/cf, FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testConsecutiveExports/98f7e39d5bcc49a04cb517441d5bbd1d/recovered.edits] 2023-07-15 03:12:11,218 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testConsecutiveExports/5face6e79a648df4d9e7791b7870bccc/cf, FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testConsecutiveExports/5face6e79a648df4d9e7791b7870bccc/recovered.edits] 2023-07-15 03:12:11,228 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testConsecutiveExports/98f7e39d5bcc49a04cb517441d5bbd1d/cf/2055e112bf1c4988a0b59d25dcf589a1 to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/archive/data/default/testtb-testConsecutiveExports/98f7e39d5bcc49a04cb517441d5bbd1d/cf/2055e112bf1c4988a0b59d25dcf589a1 2023-07-15 03:12:11,228 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testConsecutiveExports/5face6e79a648df4d9e7791b7870bccc/cf/5c546408f9434d44bb708118b093a96e to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/archive/data/default/testtb-testConsecutiveExports/5face6e79a648df4d9e7791b7870bccc/cf/5c546408f9434d44bb708118b093a96e 2023-07-15 03:12:11,233 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testConsecutiveExports/98f7e39d5bcc49a04cb517441d5bbd1d/recovered.edits/9.seqid to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/archive/data/default/testtb-testConsecutiveExports/98f7e39d5bcc49a04cb517441d5bbd1d/recovered.edits/9.seqid 2023-07-15 03:12:11,233 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testConsecutiveExports/98f7e39d5bcc49a04cb517441d5bbd1d 2023-07-15 03:12:11,235 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testConsecutiveExports/5face6e79a648df4d9e7791b7870bccc/recovered.edits/9.seqid to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/archive/data/default/testtb-testConsecutiveExports/5face6e79a648df4d9e7791b7870bccc/recovered.edits/9.seqid 2023-07-15 03:12:11,235 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testConsecutiveExports/5face6e79a648df4d9e7791b7870bccc 2023-07-15 03:12:11,235 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-15 03:12:11,236 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-15 03:12:11,237 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-15 03:12:11,242 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071599eb4df9de534cd08d892938053b12f1 to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071599eb4df9de534cd08d892938053b12f1 2023-07-15 03:12:11,244 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307155d432e29dff34cf0b7d96c37864dd58f to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307155d432e29dff34cf0b7d96c37864dd58f 2023-07-15 03:12:11,245 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-15 03:12:11,248 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 03:12:11,258 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-15 03:12:11,262 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-15 03:12:11,264 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 03:12:11,264 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-15 03:12:11,264 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689390697676.98f7e39d5bcc49a04cb517441d5bbd1d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689390731264"}]},"ts":"9223372036854775807"} 2023-07-15 03:12:11,264 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689390697676.5face6e79a648df4d9e7791b7870bccc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689390731264"}]},"ts":"9223372036854775807"} 2023-07-15 03:12:11,267 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 03:12:11,267 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 98f7e39d5bcc49a04cb517441d5bbd1d, NAME => 'testtb-testConsecutiveExports,,1689390697676.98f7e39d5bcc49a04cb517441d5bbd1d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 5face6e79a648df4d9e7791b7870bccc, NAME => 'testtb-testConsecutiveExports,1,1689390697676.5face6e79a648df4d9e7791b7870bccc.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 03:12:11,267 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-15 03:12:11,267 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689390731267"}]},"ts":"9223372036854775807"} 2023-07-15 03:12:11,271 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-15 03:12:11,273 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 03:12:11,275 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 84 msec 2023-07-15 03:12:11,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-15 03:12:11,315 INFO [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-15 03:12:11,325 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-15 03:12:11,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-15 03:12:11,329 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-15 03:12:11,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-15 03:12:11,361 INFO [Listener at jenkins-hbase4.apache.org/35095] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=745 (was 764), OpenFileDescriptor=896 (was 926), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=360 (was 394), ProcessCount=183 (was 181) - ProcessCount LEAK? -, AvailableMemoryMB=2712 (was 2417) - AvailableMemoryMB LEAK? - 2023-07-15 03:12:11,361 WARN [Listener at jenkins-hbase4.apache.org/35095] hbase.ResourceChecker(130): Thread=745 is superior to 500 2023-07-15 03:12:11,385 INFO [Listener at jenkins-hbase4.apache.org/35095] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=745, OpenFileDescriptor=896, MaxFileDescriptor=60000, SystemLoadAverage=360, ProcessCount=183, AvailableMemoryMB=2705 2023-07-15 03:12:11,385 WARN [Listener at jenkins-hbase4.apache.org/35095] hbase.ResourceChecker(130): Thread=745 is superior to 500 2023-07-15 03:12:11,387 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-15 03:12:11,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:11,391 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 03:12:11,392 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-15 03:12:11,396 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 03:12:11,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-15 03:12:11,402 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/41994ad6237867e7977d3e3c147a35d5 2023-07-15 03:12:11,404 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/41994ad6237867e7977d3e3c147a35d5 empty. 2023-07-15 03:12:11,404 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/87b0cfb7e10b096645ab55a1fdd3cb49 2023-07-15 03:12:11,404 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/41994ad6237867e7977d3e3c147a35d5 2023-07-15 03:12:11,409 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/87b0cfb7e10b096645ab55a1fdd3cb49 empty. 2023-07-15 03:12:11,410 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/87b0cfb7e10b096645ab55a1fdd3cb49 2023-07-15 03:12:11,410 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-15 03:12:11,431 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-15 03:12:11,437 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 87b0cfb7e10b096645ab55a1fdd3cb49, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689390731387.87b0cfb7e10b096645ab55a1fdd3cb49.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp 2023-07-15 03:12:11,437 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 41994ad6237867e7977d3e3c147a35d5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689390731387.41994ad6237867e7977d3e3c147a35d5.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp 2023-07-15 03:12:11,482 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689390731387.87b0cfb7e10b096645ab55a1fdd3cb49.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:12:11,483 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 87b0cfb7e10b096645ab55a1fdd3cb49, disabling compactions & flushes 2023-07-15 03:12:11,483 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689390731387.87b0cfb7e10b096645ab55a1fdd3cb49. 2023-07-15 03:12:11,483 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689390731387.87b0cfb7e10b096645ab55a1fdd3cb49. 2023-07-15 03:12:11,483 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689390731387.87b0cfb7e10b096645ab55a1fdd3cb49. after waiting 0 ms 2023-07-15 03:12:11,483 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689390731387.87b0cfb7e10b096645ab55a1fdd3cb49. 2023-07-15 03:12:11,483 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689390731387.87b0cfb7e10b096645ab55a1fdd3cb49. 2023-07-15 03:12:11,483 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 87b0cfb7e10b096645ab55a1fdd3cb49: 2023-07-15 03:12:11,488 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689390731387.41994ad6237867e7977d3e3c147a35d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:12:11,488 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 41994ad6237867e7977d3e3c147a35d5, disabling compactions & flushes 2023-07-15 03:12:11,488 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689390731387.41994ad6237867e7977d3e3c147a35d5. 2023-07-15 03:12:11,489 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689390731387.41994ad6237867e7977d3e3c147a35d5. 2023-07-15 03:12:11,489 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689390731387.41994ad6237867e7977d3e3c147a35d5. after waiting 0 ms 2023-07-15 03:12:11,489 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689390731387.41994ad6237867e7977d3e3c147a35d5. 2023-07-15 03:12:11,489 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689390731387.41994ad6237867e7977d3e3c147a35d5. 2023-07-15 03:12:11,489 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 41994ad6237867e7977d3e3c147a35d5: 2023-07-15 03:12:11,492 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 03:12:11,493 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689390731387.87b0cfb7e10b096645ab55a1fdd3cb49.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689390731493"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390731493"}]},"ts":"1689390731493"} 2023-07-15 03:12:11,493 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689390731387.41994ad6237867e7977d3e3c147a35d5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689390731493"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390731493"}]},"ts":"1689390731493"} 2023-07-15 03:12:11,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-15 03:12:11,500 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 03:12:11,501 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 03:12:11,502 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390731501"}]},"ts":"1689390731501"} 2023-07-15 03:12:11,503 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-15 03:12:11,507 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 03:12:11,508 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 03:12:11,508 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 03:12:11,508 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 03:12:11,508 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 03:12:11,509 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=41994ad6237867e7977d3e3c147a35d5, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=87b0cfb7e10b096645ab55a1fdd3cb49, ASSIGN}] 2023-07-15 03:12:11,511 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=87b0cfb7e10b096645ab55a1fdd3cb49, ASSIGN 2023-07-15 03:12:11,511 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=41994ad6237867e7977d3e3c147a35d5, ASSIGN 2023-07-15 03:12:11,512 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=87b0cfb7e10b096645ab55a1fdd3cb49, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37439,1689390651159; forceNewPlan=false, retain=false 2023-07-15 03:12:11,512 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=41994ad6237867e7977d3e3c147a35d5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40245,1689390651089; forceNewPlan=false, retain=false 2023-07-15 03:12:11,663 INFO [jenkins-hbase4:45731] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 03:12:11,666 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=87b0cfb7e10b096645ab55a1fdd3cb49, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:11,666 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=41994ad6237867e7977d3e3c147a35d5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:11,666 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689390731387.87b0cfb7e10b096645ab55a1fdd3cb49.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689390731666"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390731666"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390731666"}]},"ts":"1689390731666"} 2023-07-15 03:12:11,666 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689390731387.41994ad6237867e7977d3e3c147a35d5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689390731666"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390731666"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390731666"}]},"ts":"1689390731666"} 2023-07-15 03:12:11,672 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 87b0cfb7e10b096645ab55a1fdd3cb49, server=jenkins-hbase4.apache.org,37439,1689390651159}] 2023-07-15 03:12:11,673 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 41994ad6237867e7977d3e3c147a35d5, server=jenkins-hbase4.apache.org,40245,1689390651089}] 2023-07-15 03:12:11,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-15 03:12:11,834 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689390731387.87b0cfb7e10b096645ab55a1fdd3cb49. 2023-07-15 03:12:11,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 87b0cfb7e10b096645ab55a1fdd3cb49, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689390731387.87b0cfb7e10b096645ab55a1fdd3cb49.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 03:12:11,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689390731387.87b0cfb7e10b096645ab55a1fdd3cb49. service=AccessControlService 2023-07-15 03:12:11,835 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 03:12:11,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 87b0cfb7e10b096645ab55a1fdd3cb49 2023-07-15 03:12:11,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689390731387.87b0cfb7e10b096645ab55a1fdd3cb49.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:12:11,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 87b0cfb7e10b096645ab55a1fdd3cb49 2023-07-15 03:12:11,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 87b0cfb7e10b096645ab55a1fdd3cb49 2023-07-15 03:12:11,841 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689390731387.41994ad6237867e7977d3e3c147a35d5. 2023-07-15 03:12:11,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 41994ad6237867e7977d3e3c147a35d5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689390731387.41994ad6237867e7977d3e3c147a35d5.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 03:12:11,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689390731387.41994ad6237867e7977d3e3c147a35d5. service=AccessControlService 2023-07-15 03:12:11,842 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 03:12:11,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 41994ad6237867e7977d3e3c147a35d5 2023-07-15 03:12:11,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689390731387.41994ad6237867e7977d3e3c147a35d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:12:11,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 41994ad6237867e7977d3e3c147a35d5 2023-07-15 03:12:11,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 41994ad6237867e7977d3e3c147a35d5 2023-07-15 03:12:11,851 INFO [StoreOpener-87b0cfb7e10b096645ab55a1fdd3cb49-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 87b0cfb7e10b096645ab55a1fdd3cb49 2023-07-15 03:12:11,854 DEBUG [StoreOpener-87b0cfb7e10b096645ab55a1fdd3cb49-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion/87b0cfb7e10b096645ab55a1fdd3cb49/cf 2023-07-15 03:12:11,854 DEBUG [StoreOpener-87b0cfb7e10b096645ab55a1fdd3cb49-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion/87b0cfb7e10b096645ab55a1fdd3cb49/cf 2023-07-15 03:12:11,855 INFO [StoreOpener-87b0cfb7e10b096645ab55a1fdd3cb49-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87b0cfb7e10b096645ab55a1fdd3cb49 columnFamilyName cf 2023-07-15 03:12:11,857 INFO [StoreOpener-87b0cfb7e10b096645ab55a1fdd3cb49-1] regionserver.HStore(310): Store=87b0cfb7e10b096645ab55a1fdd3cb49/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:12:11,871 INFO [StoreOpener-41994ad6237867e7977d3e3c147a35d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 41994ad6237867e7977d3e3c147a35d5 2023-07-15 03:12:11,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion/87b0cfb7e10b096645ab55a1fdd3cb49 2023-07-15 03:12:11,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion/87b0cfb7e10b096645ab55a1fdd3cb49 2023-07-15 03:12:11,874 DEBUG [StoreOpener-41994ad6237867e7977d3e3c147a35d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion/41994ad6237867e7977d3e3c147a35d5/cf 2023-07-15 03:12:11,874 DEBUG [StoreOpener-41994ad6237867e7977d3e3c147a35d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion/41994ad6237867e7977d3e3c147a35d5/cf 2023-07-15 03:12:11,875 INFO [StoreOpener-41994ad6237867e7977d3e3c147a35d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 41994ad6237867e7977d3e3c147a35d5 columnFamilyName cf 2023-07-15 03:12:11,876 INFO [StoreOpener-41994ad6237867e7977d3e3c147a35d5-1] regionserver.HStore(310): Store=41994ad6237867e7977d3e3c147a35d5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:12:11,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 87b0cfb7e10b096645ab55a1fdd3cb49 2023-07-15 03:12:11,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion/41994ad6237867e7977d3e3c147a35d5 2023-07-15 03:12:11,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion/41994ad6237867e7977d3e3c147a35d5 2023-07-15 03:12:11,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 41994ad6237867e7977d3e3c147a35d5 2023-07-15 03:12:11,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion/87b0cfb7e10b096645ab55a1fdd3cb49/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 03:12:11,891 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 87b0cfb7e10b096645ab55a1fdd3cb49; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63052635, jitterRate=-0.060442522168159485}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 03:12:11,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 87b0cfb7e10b096645ab55a1fdd3cb49: 2023-07-15 03:12:11,893 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689390731387.87b0cfb7e10b096645ab55a1fdd3cb49., pid=60, masterSystemTime=1689390731824 2023-07-15 03:12:11,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion/41994ad6237867e7977d3e3c147a35d5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 03:12:11,893 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 41994ad6237867e7977d3e3c147a35d5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64766855, jitterRate=-0.034898653626441956}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 03:12:11,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 41994ad6237867e7977d3e3c147a35d5: 2023-07-15 03:12:11,895 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689390731387.41994ad6237867e7977d3e3c147a35d5., pid=61, masterSystemTime=1689390731827 2023-07-15 03:12:11,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689390731387.87b0cfb7e10b096645ab55a1fdd3cb49. 2023-07-15 03:12:11,895 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689390731387.87b0cfb7e10b096645ab55a1fdd3cb49. 2023-07-15 03:12:11,896 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=87b0cfb7e10b096645ab55a1fdd3cb49, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:11,896 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689390731387.87b0cfb7e10b096645ab55a1fdd3cb49.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689390731895"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689390731895"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689390731895"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689390731895"}]},"ts":"1689390731895"} 2023-07-15 03:12:11,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689390731387.41994ad6237867e7977d3e3c147a35d5. 2023-07-15 03:12:11,897 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689390731387.41994ad6237867e7977d3e3c147a35d5. 2023-07-15 03:12:11,899 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=41994ad6237867e7977d3e3c147a35d5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:11,899 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689390731387.41994ad6237867e7977d3e3c147a35d5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689390731899"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689390731899"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689390731899"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689390731899"}]},"ts":"1689390731899"} 2023-07-15 03:12:11,902 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-15 03:12:11,902 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 87b0cfb7e10b096645ab55a1fdd3cb49, server=jenkins-hbase4.apache.org,37439,1689390651159 in 227 msec 2023-07-15 03:12:11,904 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=87b0cfb7e10b096645ab55a1fdd3cb49, ASSIGN in 394 msec 2023-07-15 03:12:11,904 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-15 03:12:11,905 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 41994ad6237867e7977d3e3c147a35d5, server=jenkins-hbase4.apache.org,40245,1689390651089 in 229 msec 2023-07-15 03:12:11,907 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-15 03:12:11,907 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=41994ad6237867e7977d3e3c147a35d5, ASSIGN in 396 msec 2023-07-15 03:12:11,908 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 03:12:11,908 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390731908"}]},"ts":"1689390731908"} 2023-07-15 03:12:11,910 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-15 03:12:11,913 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 03:12:11,913 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-15 03:12:11,915 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43379] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-15 03:12:11,918 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:11,918 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:11,918 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:11,918 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:11,919 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:11,920 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:11,920 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:11,920 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:11,922 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 533 msec 2023-07-15 03:12:12,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-15 03:12:12,002 INFO [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-15 03:12:12,006 DEBUG [Listener at jenkins-hbase4.apache.org/35095] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,006 DEBUG [Listener at jenkins-hbase4.apache.org/35095] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689390731387.41994ad6237867e7977d3e3c147a35d5. 2023-07-15 03:12:12,008 INFO [Listener at jenkins-hbase4.apache.org/35095] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 03:12:12,036 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 03:12:12,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689390732036 (current time:1689390732036). 2023-07-15 03:12:12,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 03:12:12,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(139): Connect 0x7d3100cd to 127.0.0.1:58749 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:12:12,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@740cebda, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:12:12,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:12:12,050 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55706, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:12:12,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d3100cd to 127.0.0.1:58749 2023-07-15 03:12:12,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:12:12,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(139): Connect 0x68ffa45d to 127.0.0.1:58749 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:12:12,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1dbde6e7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:12:12,061 DEBUG [hconnection-0xefc9cb1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:12:12,062 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55722, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:12:12,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:12:12,069 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43204, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:12:12,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x68ffa45d to 127.0.0.1:58749 2023-07-15 03:12:12,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:12:12,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-15 03:12:12,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 03:12:12,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 03:12:12,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 03:12:12,075 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 03:12:12,076 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689391332076 2023-07-15 03:12:12,076 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 03:12:12,078 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 03:12:12,079 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 03:12:12,079 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 03:12:12,079 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 03:12:12,080 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-15 03:12:12,081 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 03:12:12,082 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689391332082 2023-07-15 03:12:12,179 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:12:12,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-15 03:12:12,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-15 03:12:12,181 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 03:12:12,381 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:12:12,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-15 03:12:12,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-15 03:12:12,382 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 03:12:12,514 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,514 INFO [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-15 03:12:12,514 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:12,514 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-15 03:12:12,514 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-15 03:12:12,515 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,515 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,518 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:12,518 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:12,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:12,518 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:12,518 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:12,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:12,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:12,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:12,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:12,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:12,518 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:12,519 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:12,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,519 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,519 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,519 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:12,519 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 03:12:12,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-15 03:12:12,520 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-15 03:12:12,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,520 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 03:12:12,520 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 03:12:12,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-15 03:12:12,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,521 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,521 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,521 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 03:12:12,521 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 03:12:12,521 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:12,521 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 03:12:12,523 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 03:12:12,523 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 03:12:12,523 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40245,1689390651089' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 03:12:12,521 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:12,525 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:12,525 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:12,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:12,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:12,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:12,526 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,526 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:12:12,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:12,526 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,527 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 03:12:12,527 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:12,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,528 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 03:12:12,528 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 03:12:12,528 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 03:12:12,529 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 03:12:12,529 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37439,1689390651159' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 03:12:12,529 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43379,1689390651212' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 03:12:12,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:12,530 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,530 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,531 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:12,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:12,531 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,531 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:12:12,531 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40245,1689390651089' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-15 03:12:12,531 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,531 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:12:12,531 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2aadc8a0[Count = 1] remaining members to acquire global barrier 2023-07-15 03:12:12,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:12,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:12,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:12,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:12,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:12,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:12,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:12,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:12,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:12,536 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37439,1689390651159' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-15 03:12:12,536 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2aadc8a0[Count = 0] remaining members to acquire global barrier 2023-07-15 03:12:12,536 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-15 03:12:12,536 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,538 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,538 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,538 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,538 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 03:12:12,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,538 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 03:12:12,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,538 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 03:12:12,539 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 03:12:12,539 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43379,1689390651212' in zk 2023-07-15 03:12:12,538 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:12,539 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:12,539 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 03:12:12,542 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:12:12,543 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:12:12,543 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:12:12,543 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:12:12,543 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689390731387.87b0cfb7e10b096645ab55a1fdd3cb49. 2023-07-15 03:12:12,543 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689390731387.87b0cfb7e10b096645ab55a1fdd3cb49. started... 2023-07-15 03:12:12,543 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689390731387.41994ad6237867e7977d3e3c147a35d5. 2023-07-15 03:12:12,543 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689390731387.41994ad6237867e7977d3e3c147a35d5. started... 2023-07-15 03:12:12,550 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 03:12:12,550 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:12,550 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 03:12:12,558 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 87b0cfb7e10b096645ab55a1fdd3cb49: 2023-07-15 03:12:12,559 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689390731387.87b0cfb7e10b096645ab55a1fdd3cb49.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,559 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:12:12,559 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 03:12:12,563 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 41994ad6237867e7977d3e3c147a35d5: 2023-07-15 03:12:12,563 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689390731387.41994ad6237867e7977d3e3c147a35d5.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,563 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:12:12,563 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 03:12:12,599 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689390731387.87b0cfb7e10b096645ab55a1fdd3cb49. completed. 2023-07-15 03:12:12,599 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689390731387.87b0cfb7e10b096645ab55a1fdd3cb49. 2023-07-15 03:12:12,599 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:12:12,600 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:12:12,600 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:12,605 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 03:12:12,605 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37439,1689390651159' in zk 2023-07-15 03:12:12,611 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689390731387.41994ad6237867e7977d3e3c147a35d5. completed. 2023-07-15 03:12:12,611 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689390731387.41994ad6237867e7977d3e3c147a35d5. 2023-07-15 03:12:12,611 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 03:12:12,611 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:12:12,611 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:12:12,611 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:12,612 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 03:12:12,612 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:12,618 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:12,619 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 03:12:12,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:12,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:12,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:12,619 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40245,1689390651089' in zk 2023-07-15 03:12:12,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:12,622 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 03:12:12,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:12,622 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:12,622 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:12,622 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 03:12:12,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:12,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:12,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:12,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:12,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:12,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:12,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:12,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,37439,1689390651159': 2023-07-15 03:12:12,631 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37439,1689390651159' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-15 03:12:12,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:12,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:12,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:12,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:12,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:12,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:12,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:12,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:12,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:12,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:12,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:12,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:12,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40245,1689390651089': 2023-07-15 03:12:12,639 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40245,1689390651089' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-15 03:12:12,639 INFO [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-15 03:12:12,639 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 03:12:12,639 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 03:12:12,639 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,639 INFO [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 03:12:12,643 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,644 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,644 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:12,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,644 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:12,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,644 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,644 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:12,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:12,644 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:12,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:12,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:12,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:12,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:12,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:12,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:12,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:12,646 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:12,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,646 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:12,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:12,647 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:12,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:12,649 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:12,649 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:12,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:12,650 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:12,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:12,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:12,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:12,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:12,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:12,655 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:12,655 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:12,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:12,655 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:12,655 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:12,655 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:12,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:12,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:12,655 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:12,655 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:12,655 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,655 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:12,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:12,657 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:12,658 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,655 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,658 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:12,658 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 03:12:12,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:12,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:12,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:12,658 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:12,658 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,658 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:12,658 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,658 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:12,658 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:12,658 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,658 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:12,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:12,659 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion because node does not exist (not an error) 2023-07-15 03:12:12,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:12,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:12,666 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-15 03:12:12,683 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:12:12,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-15 03:12:12,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-15 03:12:12,686 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-15 03:12:12,727 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,728 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,775 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,840 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-15 03:12:12,840 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,841 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:12,841 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689390732076Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689390732727 (+651 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689390732727Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689390732727Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689390732739 (+12 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689390732768 (+29 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689390732840 (+72 ms) 2023-07-15 03:12:12,844 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 03:12:12,850 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 767 msec 2023-07-15 03:12:13,187 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:12:13,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-15 03:12:13,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 03:12:13,212 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40245] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689390731387.41994ad6237867e7977d3e3c147a35d5. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 03:12:13,216 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37439] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689390731387.87b0cfb7e10b096645ab55a1fdd3cb49. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 03:12:13,220 DEBUG [Listener at jenkins-hbase4.apache.org/35095] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,220 DEBUG [Listener at jenkins-hbase4.apache.org/35095] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689390731387.41994ad6237867e7977d3e3c147a35d5. 2023-07-15 03:12:13,221 INFO [Listener at jenkins-hbase4.apache.org/35095] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 03:12:13,235 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 03:12:13,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689390733235 (current time:1689390733235). 2023-07-15 03:12:13,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 03:12:13,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(139): Connect 0x58e3936b to 127.0.0.1:58749 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:12:13,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@fec775d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:12:13,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:12:13,248 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55734, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:12:13,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58e3936b to 127.0.0.1:58749 2023-07-15 03:12:13,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:12:13,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(139): Connect 0x3fc5125c to 127.0.0.1:58749 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:12:13,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b79b604, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:12:13,271 DEBUG [hconnection-0x174370a9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:12:13,275 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55736, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:12:13,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:12:13,285 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43208, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:12:13,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3fc5125c to 127.0.0.1:58749 2023-07-15 03:12:13,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:12:13,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-15 03:12:13,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 03:12:13,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 03:12:13,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 03:12:13,293 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 03:12:13,293 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689391333293 2023-07-15 03:12:13,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 03:12:13,294 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,295 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 03:12:13,295 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 03:12:13,296 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 03:12:13,296 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 03:12:13,302 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-07-15 03:12:13,303 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 03:12:13,304 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689391333304 2023-07-15 03:12:13,335 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,335 INFO [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-15 03:12:13,335 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:13,337 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-15 03:12:13,337 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-15 03:12:13,338 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,338 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,339 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:13,339 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:13,339 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:13,339 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:13,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:13,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:13,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:13,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:13,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:13,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:13,339 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:13,340 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:13,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,340 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:13,340 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 03:12:13,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,340 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,340 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,340 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-15 03:12:13,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-15 03:12:13,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-15 03:12:13,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,341 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 03:12:13,341 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 03:12:13,341 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 03:12:13,341 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,341 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,342 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 03:12:13,342 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 03:12:13,342 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:13,342 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:13,344 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 03:12:13,344 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,344 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 03:12:13,344 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 03:12:13,344 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 03:12:13,344 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40245,1689390651089' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 03:12:13,344 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 03:12:13,344 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37439,1689390651159' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 03:12:13,344 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:13,346 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 03:12:13,346 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 03:12:13,346 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43379,1689390651212' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 03:12:13,348 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:13,348 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:13,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:13,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:13,349 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:13,349 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:13,349 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,349 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:12:13,350 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:13,350 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,350 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:12:13,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,350 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,351 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:12:13,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:13,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:13,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:13,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:13,353 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40245,1689390651089' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-15 03:12:13,353 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f475c38[Count = 1] remaining members to acquire global barrier 2023-07-15 03:12:13,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:13,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:13,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:13,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:13,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:13,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:13,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:13,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:13,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:13,356 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37439,1689390651159' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-15 03:12:13,356 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f475c38[Count = 0] remaining members to acquire global barrier 2023-07-15 03:12:13,356 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-15 03:12:13,356 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,357 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,357 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,357 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,358 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:13,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,358 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 03:12:13,358 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 03:12:13,358 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 03:12:13,358 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 03:12:13,358 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43379,1689390651212' in zk 2023-07-15 03:12:13,358 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:12:13,358 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:12:13,358 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:13,358 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689390731387.87b0cfb7e10b096645ab55a1fdd3cb49. 2023-07-15 03:12:13,358 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:12:13,358 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:12:13,359 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 03:12:13,359 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:13,360 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 03:12:13,358 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689390731387.87b0cfb7e10b096645ab55a1fdd3cb49. started... 2023-07-15 03:12:13,358 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 03:12:13,358 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689390731387.41994ad6237867e7977d3e3c147a35d5. 2023-07-15 03:12:13,361 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689390731387.41994ad6237867e7977d3e3c147a35d5. started... 2023-07-15 03:12:13,361 INFO [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 87b0cfb7e10b096645ab55a1fdd3cb49 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-15 03:12:13,361 INFO [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 41994ad6237867e7977d3e3c147a35d5 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-15 03:12:13,395 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:12:13,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-15 03:12:13,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-15 03:12:13,397 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 03:12:13,413 INFO [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307152d87bf4fb7f9402c84e31f3c7e3c1b2f to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307152d87bf4fb7f9402c84e31f3c7e3c1b2f 2023-07-15 03:12:13,432 INFO [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230715c7e5dc4775384bbb8a2d29e911d3b738 to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230715c7e5dc4775384bbb8a2d29e911d3b738 2023-07-15 03:12:13,479 INFO [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion/87b0cfb7e10b096645ab55a1fdd3cb49/.tmp/cf/8f0b3e4038064b5d9f9cc3e7fb787a0f 2023-07-15 03:12:13,488 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion/87b0cfb7e10b096645ab55a1fdd3cb49/.tmp/cf/8f0b3e4038064b5d9f9cc3e7fb787a0f as hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion/87b0cfb7e10b096645ab55a1fdd3cb49/cf/8f0b3e4038064b5d9f9cc3e7fb787a0f 2023-07-15 03:12:13,494 INFO [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion/41994ad6237867e7977d3e3c147a35d5/.tmp/cf/bc994ba9457647fb8f5eac2daa2ecec4 2023-07-15 03:12:13,495 INFO [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion/87b0cfb7e10b096645ab55a1fdd3cb49/cf/8f0b3e4038064b5d9f9cc3e7fb787a0f, entries=47, sequenceid=6, filesize=13.5 K 2023-07-15 03:12:13,497 INFO [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 87b0cfb7e10b096645ab55a1fdd3cb49 in 135ms, sequenceid=6, compaction requested=false 2023-07-15 03:12:13,497 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-15 03:12:13,497 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 87b0cfb7e10b096645ab55a1fdd3cb49: 2023-07-15 03:12:13,498 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689390731387.87b0cfb7e10b096645ab55a1fdd3cb49.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,498 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:12:13,498 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion/87b0cfb7e10b096645ab55a1fdd3cb49/cf/8f0b3e4038064b5d9f9cc3e7fb787a0f] hfiles 2023-07-15 03:12:13,498 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion/87b0cfb7e10b096645ab55a1fdd3cb49/cf/8f0b3e4038064b5d9f9cc3e7fb787a0f for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,502 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion/41994ad6237867e7977d3e3c147a35d5/.tmp/cf/bc994ba9457647fb8f5eac2daa2ecec4 as hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion/41994ad6237867e7977d3e3c147a35d5/cf/bc994ba9457647fb8f5eac2daa2ecec4 2023-07-15 03:12:13,508 INFO [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion/41994ad6237867e7977d3e3c147a35d5/cf/bc994ba9457647fb8f5eac2daa2ecec4, entries=3, sequenceid=6, filesize=5.4 K 2023-07-15 03:12:13,510 INFO [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 41994ad6237867e7977d3e3c147a35d5 in 149ms, sequenceid=6, compaction requested=false 2023-07-15 03:12:13,516 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 41994ad6237867e7977d3e3c147a35d5: 2023-07-15 03:12:13,517 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689390731387.41994ad6237867e7977d3e3c147a35d5.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,517 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:12:13,517 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion/41994ad6237867e7977d3e3c147a35d5/cf/bc994ba9457647fb8f5eac2daa2ecec4] hfiles 2023-07-15 03:12:13,517 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion/41994ad6237867e7977d3e3c147a35d5/cf/bc994ba9457647fb8f5eac2daa2ecec4 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,520 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689390731387.87b0cfb7e10b096645ab55a1fdd3cb49. completed. 2023-07-15 03:12:13,520 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689390731387.87b0cfb7e10b096645ab55a1fdd3cb49. 2023-07-15 03:12:13,520 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:12:13,520 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:12:13,520 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:13,520 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 03:12:13,520 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37439,1689390651159' in zk 2023-07-15 03:12:13,522 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:13,522 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 03:12:13,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:13,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:13,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:13,522 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:13,522 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 03:12:13,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:13,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:13,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:13,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:13,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:13,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:13,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:13,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:13,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,37439,1689390651159': 2023-07-15 03:12:13,532 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37439,1689390651159' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-15 03:12:13,543 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689390731387.41994ad6237867e7977d3e3c147a35d5. completed. 2023-07-15 03:12:13,543 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689390731387.41994ad6237867e7977d3e3c147a35d5. 2023-07-15 03:12:13,543 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:12:13,543 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:12:13,543 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:13,543 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 03:12:13,543 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40245,1689390651089' in zk 2023-07-15 03:12:13,546 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:13,546 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 03:12:13,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:13,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:13,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:13,546 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:13,546 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 03:12:13,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:13,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:13,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:13,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:13,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:13,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:13,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:13,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:13,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:13,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40245,1689390651089': 2023-07-15 03:12:13,552 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40245,1689390651089' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-15 03:12:13,552 INFO [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-15 03:12:13,552 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 03:12:13,552 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 03:12:13,552 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,552 INFO [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 03:12:13,557 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,558 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,557 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,558 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:13,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,558 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:13,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:13,558 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:13,558 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:13,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:13,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:13,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:13,559 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:13,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:13,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:13,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:13,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:13,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,559 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:13,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,560 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:13,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:13,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:13,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:13,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:13,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:13,563 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:13,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,564 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:13,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:13,564 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:13,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:13,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:13,569 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:13,569 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,569 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:13,569 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:13,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:13,569 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:13,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:13,569 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:13,569 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:13,569 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,569 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:13,569 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:13,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:13,569 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:13,569 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:13,569 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:13,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:13,571 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:13,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:13,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:13,571 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:13,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:13,571 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,572 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 03:12:13,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:13,572 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:13,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:13,572 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:13,572 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:13,572 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,572 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,573 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307152d87bf4fb7f9402c84e31f3c7e3c1b2f, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230715c7e5dc4775384bbb8a2d29e911d3b738] mob files 2023-07-15 03:12:13,573 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307152d87bf4fb7f9402c84e31f3c7e3c1b2f 2023-07-15 03:12:13,573 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230715c7e5dc4775384bbb8a2d29e911d3b738 2023-07-15 03:12:13,597 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:12:13,597 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,598 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-15 03:12:13,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-15 03:12:13,599 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 03:12:13,637 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,733 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-15 03:12:13,733 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,734 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:13,734 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689390733294Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689390733597 (+303 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689390733597Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689390733597Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689390733605 (+8 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689390733623 (+18 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689390733733 (+110 ms) 2023-07-15 03:12:13,737 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 03:12:13,744 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 442 msec 2023-07-15 03:12:13,899 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:12:13,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-15 03:12:13,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 03:12:13,941 DEBUG [Listener at jenkins-hbase4.apache.org/35095] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 03:12:13,950 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55750, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 03:12:13,952 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37439] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-15 03:12:13,953 DEBUG [Listener at jenkins-hbase4.apache.org/35095] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 03:12:13,957 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38080, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 03:12:13,957 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40245] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-15 03:12:13,958 DEBUG [Listener at jenkins-hbase4.apache.org/35095] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 03:12:13,969 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43222, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 03:12:13,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43379] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-15 03:12:13,972 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 03:12:13,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:13,979 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 03:12:13,980 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-15 03:12:13,980 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 03:12:13,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-15 03:12:14,000 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9ccb00eb8931fee23a9c67db54e35044 2023-07-15 03:12:14,001 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9ccb00eb8931fee23a9c67db54e35044 empty. 2023-07-15 03:12:14,001 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9ccb00eb8931fee23a9c67db54e35044 2023-07-15 03:12:14,002 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d88fb3a97933fbe0f2d2885cb8845a06 2023-07-15 03:12:14,003 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d88fb3a97933fbe0f2d2885cb8845a06 empty. 2023-07-15 03:12:14,004 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d88fb3a97933fbe0f2d2885cb8845a06 2023-07-15 03:12:14,004 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-15 03:12:14,051 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-15 03:12:14,055 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => d88fb3a97933fbe0f2d2885cb8845a06, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733972.d88fb3a97933fbe0f2d2885cb8845a06.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp 2023-07-15 03:12:14,067 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9ccb00eb8931fee23a9c67db54e35044, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390733972.9ccb00eb8931fee23a9c67db54e35044.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp 2023-07-15 03:12:14,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-15 03:12:14,125 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733972.d88fb3a97933fbe0f2d2885cb8845a06.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:12:14,126 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing d88fb3a97933fbe0f2d2885cb8845a06, disabling compactions & flushes 2023-07-15 03:12:14,126 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733972.d88fb3a97933fbe0f2d2885cb8845a06. 2023-07-15 03:12:14,126 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733972.d88fb3a97933fbe0f2d2885cb8845a06. 2023-07-15 03:12:14,126 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733972.d88fb3a97933fbe0f2d2885cb8845a06. after waiting 0 ms 2023-07-15 03:12:14,126 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733972.d88fb3a97933fbe0f2d2885cb8845a06. 2023-07-15 03:12:14,126 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733972.d88fb3a97933fbe0f2d2885cb8845a06. 2023-07-15 03:12:14,126 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for d88fb3a97933fbe0f2d2885cb8845a06: 2023-07-15 03:12:14,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-15 03:12:14,555 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390733972.9ccb00eb8931fee23a9c67db54e35044.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:12:14,555 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 9ccb00eb8931fee23a9c67db54e35044, disabling compactions & flushes 2023-07-15 03:12:14,555 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390733972.9ccb00eb8931fee23a9c67db54e35044. 2023-07-15 03:12:14,555 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390733972.9ccb00eb8931fee23a9c67db54e35044. 2023-07-15 03:12:14,555 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390733972.9ccb00eb8931fee23a9c67db54e35044. after waiting 0 ms 2023-07-15 03:12:14,555 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390733972.9ccb00eb8931fee23a9c67db54e35044. 2023-07-15 03:12:14,555 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390733972.9ccb00eb8931fee23a9c67db54e35044. 2023-07-15 03:12:14,555 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 9ccb00eb8931fee23a9c67db54e35044: 2023-07-15 03:12:14,561 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 03:12:14,562 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733972.d88fb3a97933fbe0f2d2885cb8845a06.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689390734562"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390734562"}]},"ts":"1689390734562"} 2023-07-15 03:12:14,562 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390733972.9ccb00eb8931fee23a9c67db54e35044.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689390734562"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390734562"}]},"ts":"1689390734562"} 2023-07-15 03:12:14,568 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 03:12:14,569 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 03:12:14,569 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390734569"}]},"ts":"1689390734569"} 2023-07-15 03:12:14,571 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-15 03:12:14,575 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 03:12:14,576 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 03:12:14,576 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 03:12:14,576 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 03:12:14,576 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 03:12:14,577 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d88fb3a97933fbe0f2d2885cb8845a06, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9ccb00eb8931fee23a9c67db54e35044, ASSIGN}] 2023-07-15 03:12:14,580 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9ccb00eb8931fee23a9c67db54e35044, ASSIGN 2023-07-15 03:12:14,580 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d88fb3a97933fbe0f2d2885cb8845a06, ASSIGN 2023-07-15 03:12:14,581 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9ccb00eb8931fee23a9c67db54e35044, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37439,1689390651159; forceNewPlan=false, retain=false 2023-07-15 03:12:14,581 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d88fb3a97933fbe0f2d2885cb8845a06, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43379,1689390651212; forceNewPlan=false, retain=false 2023-07-15 03:12:14,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-15 03:12:14,731 INFO [jenkins-hbase4:45731] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 03:12:14,735 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=9ccb00eb8931fee23a9c67db54e35044, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:14,735 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=d88fb3a97933fbe0f2d2885cb8845a06, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:14,735 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390733972.9ccb00eb8931fee23a9c67db54e35044.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689390734735"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390734735"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390734735"}]},"ts":"1689390734735"} 2023-07-15 03:12:14,735 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733972.d88fb3a97933fbe0f2d2885cb8845a06.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689390734735"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390734735"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390734735"}]},"ts":"1689390734735"} 2023-07-15 03:12:14,738 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 9ccb00eb8931fee23a9c67db54e35044, server=jenkins-hbase4.apache.org,37439,1689390651159}] 2023-07-15 03:12:14,742 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure d88fb3a97933fbe0f2d2885cb8845a06, server=jenkins-hbase4.apache.org,43379,1689390651212}] 2023-07-15 03:12:14,896 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390733972.9ccb00eb8931fee23a9c67db54e35044. 2023-07-15 03:12:14,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9ccb00eb8931fee23a9c67db54e35044, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390733972.9ccb00eb8931fee23a9c67db54e35044.', STARTKEY => '2', ENDKEY => ''} 2023-07-15 03:12:14,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390733972.9ccb00eb8931fee23a9c67db54e35044. service=AccessControlService 2023-07-15 03:12:14,898 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 03:12:14,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 9ccb00eb8931fee23a9c67db54e35044 2023-07-15 03:12:14,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390733972.9ccb00eb8931fee23a9c67db54e35044.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:12:14,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9ccb00eb8931fee23a9c67db54e35044 2023-07-15 03:12:14,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9ccb00eb8931fee23a9c67db54e35044 2023-07-15 03:12:14,906 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733972.d88fb3a97933fbe0f2d2885cb8845a06. 2023-07-15 03:12:14,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d88fb3a97933fbe0f2d2885cb8845a06, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733972.d88fb3a97933fbe0f2d2885cb8845a06.', STARTKEY => '', ENDKEY => '2'} 2023-07-15 03:12:14,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733972.d88fb3a97933fbe0f2d2885cb8845a06. service=AccessControlService 2023-07-15 03:12:14,906 INFO [StoreOpener-9ccb00eb8931fee23a9c67db54e35044-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9ccb00eb8931fee23a9c67db54e35044 2023-07-15 03:12:14,906 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 03:12:14,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 d88fb3a97933fbe0f2d2885cb8845a06 2023-07-15 03:12:14,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733972.d88fb3a97933fbe0f2d2885cb8845a06.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:12:14,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d88fb3a97933fbe0f2d2885cb8845a06 2023-07-15 03:12:14,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d88fb3a97933fbe0f2d2885cb8845a06 2023-07-15 03:12:14,908 DEBUG [StoreOpener-9ccb00eb8931fee23a9c67db54e35044-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9ccb00eb8931fee23a9c67db54e35044/cf 2023-07-15 03:12:14,908 DEBUG [StoreOpener-9ccb00eb8931fee23a9c67db54e35044-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9ccb00eb8931fee23a9c67db54e35044/cf 2023-07-15 03:12:14,908 INFO [StoreOpener-9ccb00eb8931fee23a9c67db54e35044-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9ccb00eb8931fee23a9c67db54e35044 columnFamilyName cf 2023-07-15 03:12:14,909 INFO [StoreOpener-9ccb00eb8931fee23a9c67db54e35044-1] regionserver.HStore(310): Store=9ccb00eb8931fee23a9c67db54e35044/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:12:14,911 INFO [StoreOpener-d88fb3a97933fbe0f2d2885cb8845a06-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d88fb3a97933fbe0f2d2885cb8845a06 2023-07-15 03:12:14,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9ccb00eb8931fee23a9c67db54e35044 2023-07-15 03:12:14,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9ccb00eb8931fee23a9c67db54e35044 2023-07-15 03:12:14,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9ccb00eb8931fee23a9c67db54e35044 2023-07-15 03:12:14,917 DEBUG [StoreOpener-d88fb3a97933fbe0f2d2885cb8845a06-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d88fb3a97933fbe0f2d2885cb8845a06/cf 2023-07-15 03:12:14,917 DEBUG [StoreOpener-d88fb3a97933fbe0f2d2885cb8845a06-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d88fb3a97933fbe0f2d2885cb8845a06/cf 2023-07-15 03:12:14,918 INFO [StoreOpener-d88fb3a97933fbe0f2d2885cb8845a06-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d88fb3a97933fbe0f2d2885cb8845a06 columnFamilyName cf 2023-07-15 03:12:14,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9ccb00eb8931fee23a9c67db54e35044/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 03:12:14,918 INFO [StoreOpener-d88fb3a97933fbe0f2d2885cb8845a06-1] regionserver.HStore(310): Store=d88fb3a97933fbe0f2d2885cb8845a06/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:12:14,919 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9ccb00eb8931fee23a9c67db54e35044; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68523644, jitterRate=0.021081864833831787}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 03:12:14,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9ccb00eb8931fee23a9c67db54e35044: 2023-07-15 03:12:14,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d88fb3a97933fbe0f2d2885cb8845a06 2023-07-15 03:12:14,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d88fb3a97933fbe0f2d2885cb8845a06 2023-07-15 03:12:14,923 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390733972.9ccb00eb8931fee23a9c67db54e35044., pid=69, masterSystemTime=1689390734892 2023-07-15 03:12:14,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d88fb3a97933fbe0f2d2885cb8845a06 2023-07-15 03:12:14,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390733972.9ccb00eb8931fee23a9c67db54e35044. 2023-07-15 03:12:14,925 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390733972.9ccb00eb8931fee23a9c67db54e35044. 2023-07-15 03:12:14,926 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=9ccb00eb8931fee23a9c67db54e35044, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:14,926 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390733972.9ccb00eb8931fee23a9c67db54e35044.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689390734926"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689390734926"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689390734926"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689390734926"}]},"ts":"1689390734926"} 2023-07-15 03:12:14,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d88fb3a97933fbe0f2d2885cb8845a06/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 03:12:14,931 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d88fb3a97933fbe0f2d2885cb8845a06; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71351355, jitterRate=0.06321804225444794}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 03:12:14,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d88fb3a97933fbe0f2d2885cb8845a06: 2023-07-15 03:12:14,931 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733972.d88fb3a97933fbe0f2d2885cb8845a06., pid=70, masterSystemTime=1689390734894 2023-07-15 03:12:14,935 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-15 03:12:14,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733972.d88fb3a97933fbe0f2d2885cb8845a06. 2023-07-15 03:12:14,935 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733972.d88fb3a97933fbe0f2d2885cb8845a06. 2023-07-15 03:12:14,935 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 9ccb00eb8931fee23a9c67db54e35044, server=jenkins-hbase4.apache.org,37439,1689390651159 in 193 msec 2023-07-15 03:12:14,935 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=d88fb3a97933fbe0f2d2885cb8845a06, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:14,935 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733972.d88fb3a97933fbe0f2d2885cb8845a06.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689390734935"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689390734935"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689390734935"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689390734935"}]},"ts":"1689390734935"} 2023-07-15 03:12:14,939 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9ccb00eb8931fee23a9c67db54e35044, ASSIGN in 358 msec 2023-07-15 03:12:14,940 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-15 03:12:14,940 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure d88fb3a97933fbe0f2d2885cb8845a06, server=jenkins-hbase4.apache.org,43379,1689390651212 in 195 msec 2023-07-15 03:12:14,943 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-15 03:12:14,944 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d88fb3a97933fbe0f2d2885cb8845a06, ASSIGN in 363 msec 2023-07-15 03:12:14,945 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 03:12:14,945 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390734945"}]},"ts":"1689390734945"} 2023-07-15 03:12:14,947 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-15 03:12:14,951 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 03:12:14,952 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-15 03:12:14,954 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43379] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-15 03:12:14,955 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:14,957 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:14,967 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:14,967 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:14,968 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:14,968 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:14,969 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:14,969 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:14,970 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:14,970 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:14,970 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:14,970 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:14,971 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 996 msec 2023-07-15 03:12:15,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-15 03:12:15,088 INFO [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-15 03:12:15,132 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions d88fb3a97933fbe0f2d2885cb8845a06, 9ccb00eb8931fee23a9c67db54e35044 2023-07-15 03:12:15,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d88fb3a97933fbe0f2d2885cb8845a06, 9ccb00eb8931fee23a9c67db54e35044], force=true 2023-07-15 03:12:15,145 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d88fb3a97933fbe0f2d2885cb8845a06, 9ccb00eb8931fee23a9c67db54e35044], force=true 2023-07-15 03:12:15,145 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d88fb3a97933fbe0f2d2885cb8845a06, 9ccb00eb8931fee23a9c67db54e35044], force=true 2023-07-15 03:12:15,145 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d88fb3a97933fbe0f2d2885cb8845a06, 9ccb00eb8931fee23a9c67db54e35044], force=true 2023-07-15 03:12:15,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 03:12:15,173 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d88fb3a97933fbe0f2d2885cb8845a06, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9ccb00eb8931fee23a9c67db54e35044, UNASSIGN}] 2023-07-15 03:12:15,176 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d88fb3a97933fbe0f2d2885cb8845a06, UNASSIGN 2023-07-15 03:12:15,176 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9ccb00eb8931fee23a9c67db54e35044, UNASSIGN 2023-07-15 03:12:15,177 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=9ccb00eb8931fee23a9c67db54e35044, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:15,177 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=d88fb3a97933fbe0f2d2885cb8845a06, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:15,177 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390733972.9ccb00eb8931fee23a9c67db54e35044.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689390735177"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390735177"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390735177"}]},"ts":"1689390735177"} 2023-07-15 03:12:15,177 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733972.d88fb3a97933fbe0f2d2885cb8845a06.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689390735177"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390735177"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390735177"}]},"ts":"1689390735177"} 2023-07-15 03:12:15,179 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure d88fb3a97933fbe0f2d2885cb8845a06, server=jenkins-hbase4.apache.org,43379,1689390651212}] 2023-07-15 03:12:15,180 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 9ccb00eb8931fee23a9c67db54e35044, server=jenkins-hbase4.apache.org,37439,1689390651159}] 2023-07-15 03:12:15,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 03:12:15,332 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d88fb3a97933fbe0f2d2885cb8845a06 2023-07-15 03:12:15,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d88fb3a97933fbe0f2d2885cb8845a06, disabling compactions & flushes 2023-07-15 03:12:15,334 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733972.d88fb3a97933fbe0f2d2885cb8845a06. 2023-07-15 03:12:15,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733972.d88fb3a97933fbe0f2d2885cb8845a06. 2023-07-15 03:12:15,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733972.d88fb3a97933fbe0f2d2885cb8845a06. after waiting 0 ms 2023-07-15 03:12:15,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733972.d88fb3a97933fbe0f2d2885cb8845a06. 2023-07-15 03:12:15,334 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing d88fb3a97933fbe0f2d2885cb8845a06 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-15 03:12:15,335 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9ccb00eb8931fee23a9c67db54e35044 2023-07-15 03:12:15,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9ccb00eb8931fee23a9c67db54e35044, disabling compactions & flushes 2023-07-15 03:12:15,337 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390733972.9ccb00eb8931fee23a9c67db54e35044. 2023-07-15 03:12:15,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390733972.9ccb00eb8931fee23a9c67db54e35044. 2023-07-15 03:12:15,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390733972.9ccb00eb8931fee23a9c67db54e35044. after waiting 0 ms 2023-07-15 03:12:15,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390733972.9ccb00eb8931fee23a9c67db54e35044. 2023-07-15 03:12:15,337 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 9ccb00eb8931fee23a9c67db54e35044 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-15 03:12:15,354 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d88fb3a97933fbe0f2d2885cb8845a06/.tmp/cf/b7cf5a65b7f1470bb73aae180f1e8dfe 2023-07-15 03:12:15,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d88fb3a97933fbe0f2d2885cb8845a06/.tmp/cf/b7cf5a65b7f1470bb73aae180f1e8dfe as hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d88fb3a97933fbe0f2d2885cb8845a06/cf/b7cf5a65b7f1470bb73aae180f1e8dfe 2023-07-15 03:12:15,387 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d88fb3a97933fbe0f2d2885cb8845a06/cf/b7cf5a65b7f1470bb73aae180f1e8dfe, entries=1, sequenceid=5, filesize=4.7 K 2023-07-15 03:12:15,388 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for d88fb3a97933fbe0f2d2885cb8845a06 in 54ms, sequenceid=5, compaction requested=false 2023-07-15 03:12:15,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-15 03:12:15,409 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d88fb3a97933fbe0f2d2885cb8845a06/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-15 03:12:15,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:12:15,410 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733972.d88fb3a97933fbe0f2d2885cb8845a06. 2023-07-15 03:12:15,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d88fb3a97933fbe0f2d2885cb8845a06: 2023-07-15 03:12:15,414 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d88fb3a97933fbe0f2d2885cb8845a06 2023-07-15 03:12:15,415 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=d88fb3a97933fbe0f2d2885cb8845a06, regionState=CLOSED 2023-07-15 03:12:15,415 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733972.d88fb3a97933fbe0f2d2885cb8845a06.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689390735415"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390735415"}]},"ts":"1689390735415"} 2023-07-15 03:12:15,423 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-15 03:12:15,423 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure d88fb3a97933fbe0f2d2885cb8845a06, server=jenkins-hbase4.apache.org,43379,1689390651212 in 238 msec 2023-07-15 03:12:15,424 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d88fb3a97933fbe0f2d2885cb8845a06, UNASSIGN in 253 msec 2023-07-15 03:12:15,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 03:12:15,499 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660272_0004_000001 (auth:SIMPLE) 2023-07-15 03:12:15,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 03:12:15,767 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9ccb00eb8931fee23a9c67db54e35044/.tmp/cf/ae9e89a8b4b446ee85965935191c3924 2023-07-15 03:12:15,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9ccb00eb8931fee23a9c67db54e35044/.tmp/cf/ae9e89a8b4b446ee85965935191c3924 as hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9ccb00eb8931fee23a9c67db54e35044/cf/ae9e89a8b4b446ee85965935191c3924 2023-07-15 03:12:15,780 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9ccb00eb8931fee23a9c67db54e35044/cf/ae9e89a8b4b446ee85965935191c3924, entries=1, sequenceid=5, filesize=4.7 K 2023-07-15 03:12:15,781 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 9ccb00eb8931fee23a9c67db54e35044 in 444ms, sequenceid=5, compaction requested=false 2023-07-15 03:12:15,799 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9ccb00eb8931fee23a9c67db54e35044/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-15 03:12:15,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:12:15,800 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390733972.9ccb00eb8931fee23a9c67db54e35044. 2023-07-15 03:12:15,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9ccb00eb8931fee23a9c67db54e35044: 2023-07-15 03:12:15,801 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9ccb00eb8931fee23a9c67db54e35044 2023-07-15 03:12:15,802 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=9ccb00eb8931fee23a9c67db54e35044, regionState=CLOSED 2023-07-15 03:12:15,802 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390733972.9ccb00eb8931fee23a9c67db54e35044.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689390735802"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390735802"}]},"ts":"1689390735802"} 2023-07-15 03:12:15,811 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-15 03:12:15,811 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 9ccb00eb8931fee23a9c67db54e35044, server=jenkins-hbase4.apache.org,37439,1689390651159 in 626 msec 2023-07-15 03:12:15,813 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-15 03:12:15,813 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9ccb00eb8931fee23a9c67db54e35044, UNASSIGN in 638 msec 2023-07-15 03:12:15,895 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7b1a169d88a04ba673b87c02f178f461/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-15 03:12:15,897 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733972.d88fb3a97933fbe0f2d2885cb8845a06.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-15 03:12:15,898 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689390733972.9ccb00eb8931fee23a9c67db54e35044.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-15 03:12:15,898 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733973.7b1a169d88a04ba673b87c02f178f461.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-15 03:12:15,968 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7b1a169d88a04ba673b87c02f178f461, ASSIGN}] 2023-07-15 03:12:15,972 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7b1a169d88a04ba673b87c02f178f461, ASSIGN 2023-07-15 03:12:15,974 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7b1a169d88a04ba673b87c02f178f461, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,43379,1689390651212; forceNewPlan=false, retain=false 2023-07-15 03:12:16,124 INFO [jenkins-hbase4:45731] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-15 03:12:16,126 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=7b1a169d88a04ba673b87c02f178f461, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:16,126 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733973.7b1a169d88a04ba673b87c02f178f461.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689390736126"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390736126"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390736126"}]},"ts":"1689390736126"} 2023-07-15 03:12:16,128 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 7b1a169d88a04ba673b87c02f178f461, server=jenkins-hbase4.apache.org,43379,1689390651212}] 2023-07-15 03:12:16,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 03:12:16,284 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733973.7b1a169d88a04ba673b87c02f178f461. 2023-07-15 03:12:16,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7b1a169d88a04ba673b87c02f178f461, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733973.7b1a169d88a04ba673b87c02f178f461.', STARTKEY => '', ENDKEY => ''} 2023-07-15 03:12:16,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733973.7b1a169d88a04ba673b87c02f178f461. service=AccessControlService 2023-07-15 03:12:16,284 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 03:12:16,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 7b1a169d88a04ba673b87c02f178f461 2023-07-15 03:12:16,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733973.7b1a169d88a04ba673b87c02f178f461.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:12:16,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7b1a169d88a04ba673b87c02f178f461 2023-07-15 03:12:16,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7b1a169d88a04ba673b87c02f178f461 2023-07-15 03:12:16,286 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7b1a169d88a04ba673b87c02f178f461/.regioninfo 2023-07-15 03:12:16,313 INFO [StoreOpener-7b1a169d88a04ba673b87c02f178f461-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7b1a169d88a04ba673b87c02f178f461 2023-07-15 03:12:16,314 DEBUG [StoreOpener-7b1a169d88a04ba673b87c02f178f461-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7b1a169d88a04ba673b87c02f178f461/cf 2023-07-15 03:12:16,315 DEBUG [StoreOpener-7b1a169d88a04ba673b87c02f178f461-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7b1a169d88a04ba673b87c02f178f461/cf 2023-07-15 03:12:16,315 INFO [StoreOpener-7b1a169d88a04ba673b87c02f178f461-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7b1a169d88a04ba673b87c02f178f461 columnFamilyName cf 2023-07-15 03:12:16,360 DEBUG [StoreOpener-7b1a169d88a04ba673b87c02f178f461-1] regionserver.HStore(539): loaded hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7b1a169d88a04ba673b87c02f178f461/cf/ae9e89a8b4b446ee85965935191c3924.9ccb00eb8931fee23a9c67db54e35044->hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9ccb00eb8931fee23a9c67db54e35044/cf/ae9e89a8b4b446ee85965935191c3924-top 2023-07-15 03:12:16,393 DEBUG [StoreOpener-7b1a169d88a04ba673b87c02f178f461-1] regionserver.HStore(539): loaded hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7b1a169d88a04ba673b87c02f178f461/cf/b7cf5a65b7f1470bb73aae180f1e8dfe.d88fb3a97933fbe0f2d2885cb8845a06->hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d88fb3a97933fbe0f2d2885cb8845a06/cf/b7cf5a65b7f1470bb73aae180f1e8dfe-top 2023-07-15 03:12:16,393 INFO [StoreOpener-7b1a169d88a04ba673b87c02f178f461-1] regionserver.HStore(310): Store=7b1a169d88a04ba673b87c02f178f461/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:12:16,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7b1a169d88a04ba673b87c02f178f461 2023-07-15 03:12:16,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7b1a169d88a04ba673b87c02f178f461 2023-07-15 03:12:16,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7b1a169d88a04ba673b87c02f178f461 2023-07-15 03:12:16,408 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7b1a169d88a04ba673b87c02f178f461; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61809602, jitterRate=-0.07896515727043152}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 03:12:16,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7b1a169d88a04ba673b87c02f178f461: 2023-07-15 03:12:16,409 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733973.7b1a169d88a04ba673b87c02f178f461., pid=77, masterSystemTime=1689390736280 2023-07-15 03:12:16,409 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733973.7b1a169d88a04ba673b87c02f178f461.,because compaction is disabled. 2023-07-15 03:12:16,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733973.7b1a169d88a04ba673b87c02f178f461. 2023-07-15 03:12:16,412 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733973.7b1a169d88a04ba673b87c02f178f461. 2023-07-15 03:12:16,414 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=7b1a169d88a04ba673b87c02f178f461, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:16,414 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733973.7b1a169d88a04ba673b87c02f178f461.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689390736414"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689390736414"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689390736414"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689390736414"}]},"ts":"1689390736414"} 2023-07-15 03:12:16,421 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-15 03:12:16,421 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 7b1a169d88a04ba673b87c02f178f461, server=jenkins-hbase4.apache.org,43379,1689390651212 in 288 msec 2023-07-15 03:12:16,423 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-15 03:12:16,423 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7b1a169d88a04ba673b87c02f178f461, ASSIGN in 453 msec 2023-07-15 03:12:16,432 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[d88fb3a97933fbe0f2d2885cb8845a06, 9ccb00eb8931fee23a9c67db54e35044], force=true in 1.2870 sec 2023-07-15 03:12:16,712 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 03:12:17,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 03:12:17,259 INFO [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-15 03:12:17,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-15 03:12:17,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689390737260 (current time:1689390737260). 2023-07-15 03:12:17,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 03:12:17,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(139): Connect 0x6bdbb648 to 127.0.0.1:58749 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:12:17,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b83b20d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:12:17,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:12:17,328 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55760, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:12:17,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6bdbb648 to 127.0.0.1:58749 2023-07-15 03:12:17,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:12:17,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(139): Connect 0x1d5c1390 to 127.0.0.1:58749 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:12:17,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b839f85, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:12:17,452 DEBUG [hconnection-0x7d465322-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:12:17,457 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55768, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:12:17,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:12:17,471 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43230, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:12:17,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1d5c1390 to 127.0.0.1:58749 2023-07-15 03:12:17,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:12:17,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-15 03:12:17,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 03:12:17,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-15 03:12:17,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-15 03:12:17,478 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-15 03:12:17,479 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689391337479 2023-07-15 03:12:17,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-15 03:12:17,479 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,484 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 03:12:17,485 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 03:12:17,486 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-15 03:12:17,487 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-15 03:12:17,490 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 12 msec 2023-07-15 03:12:17,494 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-15 03:12:17,495 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689391337495 2023-07-15 03:12:17,526 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,526 INFO [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-15 03:12:17,526 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:17,528 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-15 03:12:17,528 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-15 03:12:17,577 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,577 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,579 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:17,579 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:17,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:17,579 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:17,579 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:17,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:17,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:17,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:17,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:17,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:17,580 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:17,580 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 03:12:17,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,581 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,581 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,581 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-15 03:12:17,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-15 03:12:17,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-15 03:12:17,581 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-15 03:12:17,581 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-15 03:12:17,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,582 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,582 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-15 03:12:17,582 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-15 03:12:17,582 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:17,582 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,582 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-15 03:12:17,582 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:17,582 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,582 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-15 03:12:17,582 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:17,584 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-15 03:12:17,584 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-15 03:12:17,584 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-15 03:12:17,584 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-15 03:12:17,584 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37439,1689390651159' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-15 03:12:17,584 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-15 03:12:17,584 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-15 03:12:17,584 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40245,1689390651089' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-15 03:12:17,584 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43379,1689390651212' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-15 03:12:17,585 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:12:17,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-15 03:12:17,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-15 03:12:17,586 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,586 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 03:12:17,587 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:17,587 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,587 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,587 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:12:17,587 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:17,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:17,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:17,592 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:17,592 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,593 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:12:17,592 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:12:17,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:17,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:17,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:17,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:17,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:17,595 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43379,1689390651212' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-15 03:12:17,595 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3dc3e219[Count = 0] remaining members to acquire global barrier 2023-07-15 03:12:17,595 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-15 03:12:17,595 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,596 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,596 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,596 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,596 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-15 03:12:17,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,597 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-15 03:12:17,597 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:17,597 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 03:12:17,597 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-15 03:12:17,597 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-15 03:12:17,597 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,37439,1689390651159' in zk 2023-07-15 03:12:17,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,597 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,40245,1689390651089' in zk 2023-07-15 03:12:17,597 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-15 03:12:17,597 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:12:17,597 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:12:17,597 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689390651212)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733973.7b1a169d88a04ba673b87c02f178f461. 2023-07-15 03:12:17,597 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689390651212)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733973.7b1a169d88a04ba673b87c02f178f461. started... 2023-07-15 03:12:17,599 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689390651212)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7b1a169d88a04ba673b87c02f178f461: 2023-07-15 03:12:17,599 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-15 03:12:17,599 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689390651212)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733973.7b1a169d88a04ba673b87c02f178f461.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,599 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:17,599 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689390651212)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:12:17,599 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-15 03:12:17,600 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-15 03:12:17,600 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:17,600 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689390651212)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7b1a169d88a04ba673b87c02f178f461/cf/ae9e89a8b4b446ee85965935191c3924.9ccb00eb8931fee23a9c67db54e35044->hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9ccb00eb8931fee23a9c67db54e35044/cf/ae9e89a8b4b446ee85965935191c3924-top, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7b1a169d88a04ba673b87c02f178f461/cf/b7cf5a65b7f1470bb73aae180f1e8dfe.d88fb3a97933fbe0f2d2885cb8845a06->hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d88fb3a97933fbe0f2d2885cb8845a06/cf/b7cf5a65b7f1470bb73aae180f1e8dfe-top] hfiles 2023-07-15 03:12:17,600 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-15 03:12:17,604 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689390651212)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7b1a169d88a04ba673b87c02f178f461/cf/ae9e89a8b4b446ee85965935191c3924.9ccb00eb8931fee23a9c67db54e35044 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,604 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689390651212)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7b1a169d88a04ba673b87c02f178f461/cf/b7cf5a65b7f1470bb73aae180f1e8dfe.d88fb3a97933fbe0f2d2885cb8845a06 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,621 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689390651212)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733973.7b1a169d88a04ba673b87c02f178f461. completed. 2023-07-15 03:12:17,622 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689390651212)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733973.7b1a169d88a04ba673b87c02f178f461. 2023-07-15 03:12:17,622 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:12:17,622 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:12:17,622 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:17,622 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-15 03:12:17,622 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,43379,1689390651212' in zk 2023-07-15 03:12:17,628 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:17,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:17,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:17,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:17,628 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-15 03:12:17,628 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:17,628 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-15 03:12:17,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:17,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:17,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:17,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:17,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:17,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:17,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:17,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:17,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:17,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,43379,1689390651212': 2023-07-15 03:12:17,631 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43379,1689390651212' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-15 03:12:17,631 INFO [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-15 03:12:17,631 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 03:12:17,632 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 03:12:17,632 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,632 INFO [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 03:12:17,633 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,633 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,634 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,633 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,633 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:17,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:17,633 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:17,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:17,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,634 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:17,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:17,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:17,634 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:17,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:17,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:17,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:17,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:17,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:17,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,636 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:17,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,636 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:17,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:17,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:17,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:17,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:17,638 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:17,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:17,638 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:17,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,638 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:17,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:17,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:17,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:17,643 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:17,643 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:17,643 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:17,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:17,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:17,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:17,643 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,643 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:17,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:17,643 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:17,643 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:17,643 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:17,643 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:17,643 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,643 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:17,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:17,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:17,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:17,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:17,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:17,643 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:17,644 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:17,643 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:17,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:17,644 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,645 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:17,645 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,645 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:17,645 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:17,645 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,645 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,680 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,712 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-15 03:12:17,712 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,713 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,713 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689390737479Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689390737643 (+164 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689390737644 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689390737648 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689390737667 (+19 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689390737712 (+45 ms) 2023-07-15 03:12:17,716 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-15 03:12:17,718 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 232 msec 2023-07-15 03:12:17,786 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:12:17,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-15 03:12:17,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 03:12:17,796 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390737796 2023-07-15 03:12:17,796 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33795, tgtDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390737796, rawTgtDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390737796, srcFsUri=hdfs://localhost:33795, srcDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d 2023-07-15 03:12:17,833 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33795, inputRoot=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d 2023-07-15 03:12:17,833 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1719745046_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390737796, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390737796/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,833 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33795, inputRoot=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d, snapshotDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-15 03:12:17,849 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390737796/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:17,914 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:17,914 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:17,915 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:17,915 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:18,967 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/hadoop-2818420643622525483.jar 2023-07-15 03:12:18,967 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:18,968 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:19,044 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/hadoop-6775481683569392305.jar 2023-07-15 03:12:19,044 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:19,045 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:19,045 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:19,045 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:19,046 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:19,046 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:19,046 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 03:12:19,047 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 03:12:19,047 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 03:12:19,048 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 03:12:19,048 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 03:12:19,049 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 03:12:19,049 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 03:12:19,049 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 03:12:19,050 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 03:12:19,050 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 03:12:19,051 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:12:19,051 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:12:19,052 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 03:12:19,052 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:12:19,052 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:12:19,053 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 03:12:19,054 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 03:12:19,693 WARN [Listener at jenkins-hbase4.apache.org/35095] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 03:12:19,696 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-15 03:12:19,698 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-15 03:12:19,826 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 03:12:19,826 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 03:12:19,865 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660272_0005_000001 (auth:SIMPLE) 2023-07-15 03:12:21,795 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 03:12:26,431 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660272_0005_000001 (auth:SIMPLE) 2023-07-15 03:12:28,738 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660272_0005_000001 (auth:SIMPLE) 2023-07-15 03:12:34,043 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660272_0005_000001 (auth:SIMPLE) 2023-07-15 03:12:36,001 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 03:12:36,007 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 03:12:36,017 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:36,018 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 03:12:36,018 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 03:12:36,018 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_351679589_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:36,019 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(367): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-15 03:12:36,019 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(367): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-15 03:12:36,019 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_351679589_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390737796/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390737796/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:36,019 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(367): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390737796/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-15 03:12:36,019 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(367): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390737796/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-15 03:12:36,029 INFO [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:36,029 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:36,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:36,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-15 03:12:36,034 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390756034"}]},"ts":"1689390756034"} 2023-07-15 03:12:36,036 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-15 03:12:36,037 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-15 03:12:36,038 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7b1a169d88a04ba673b87c02f178f461, UNASSIGN}] 2023-07-15 03:12:36,040 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7b1a169d88a04ba673b87c02f178f461, UNASSIGN 2023-07-15 03:12:36,040 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=7b1a169d88a04ba673b87c02f178f461, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:36,040 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733973.7b1a169d88a04ba673b87c02f178f461.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689390756040"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390756040"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390756040"}]},"ts":"1689390756040"} 2023-07-15 03:12:36,042 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 7b1a169d88a04ba673b87c02f178f461, server=jenkins-hbase4.apache.org,43379,1689390651212}] 2023-07-15 03:12:36,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-15 03:12:36,195 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7b1a169d88a04ba673b87c02f178f461 2023-07-15 03:12:36,195 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7b1a169d88a04ba673b87c02f178f461, disabling compactions & flushes 2023-07-15 03:12:36,195 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733973.7b1a169d88a04ba673b87c02f178f461. 2023-07-15 03:12:36,195 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733973.7b1a169d88a04ba673b87c02f178f461. 2023-07-15 03:12:36,195 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733973.7b1a169d88a04ba673b87c02f178f461. after waiting 0 ms 2023-07-15 03:12:36,195 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733973.7b1a169d88a04ba673b87c02f178f461. 2023-07-15 03:12:36,209 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7b1a169d88a04ba673b87c02f178f461/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-15 03:12:36,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:12:36,211 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733973.7b1a169d88a04ba673b87c02f178f461. 2023-07-15 03:12:36,211 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7b1a169d88a04ba673b87c02f178f461: 2023-07-15 03:12:36,213 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7b1a169d88a04ba673b87c02f178f461 2023-07-15 03:12:36,214 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=7b1a169d88a04ba673b87c02f178f461, regionState=CLOSED 2023-07-15 03:12:36,215 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733973.7b1a169d88a04ba673b87c02f178f461.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689390756214"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390756214"}]},"ts":"1689390756214"} 2023-07-15 03:12:36,231 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-15 03:12:36,232 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 7b1a169d88a04ba673b87c02f178f461, server=jenkins-hbase4.apache.org,43379,1689390651212 in 185 msec 2023-07-15 03:12:36,235 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-15 03:12:36,235 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7b1a169d88a04ba673b87c02f178f461, UNASSIGN in 194 msec 2023-07-15 03:12:36,238 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390756238"}]},"ts":"1689390756238"} 2023-07-15 03:12:36,240 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-15 03:12:36,242 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-15 03:12:36,244 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 214 msec 2023-07-15 03:12:36,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-15 03:12:36,337 INFO [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-15 03:12:36,338 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:36,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:36,342 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:36,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:36,342 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:36,344 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43379] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:36,347 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:36,347 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:36,347 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:36,347 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:36,347 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9ccb00eb8931fee23a9c67db54e35044 2023-07-15 03:12:36,348 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-15 03:12:36,348 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d88fb3a97933fbe0f2d2885cb8845a06 2023-07-15 03:12:36,347 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-15 03:12:36,347 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-15 03:12:36,348 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7b1a169d88a04ba673b87c02f178f461 2023-07-15 03:12:36,350 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:36,350 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:36,350 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:36,350 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9ccb00eb8931fee23a9c67db54e35044/cf, FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9ccb00eb8931fee23a9c67db54e35044/recovered.edits] 2023-07-15 03:12:36,350 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:36,350 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:36,350 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-15 03:12:36,350 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-15 03:12:36,350 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:36,350 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:36,351 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7b1a169d88a04ba673b87c02f178f461/cf, FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7b1a169d88a04ba673b87c02f178f461/recovered.edits] 2023-07-15 03:12:36,351 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d88fb3a97933fbe0f2d2885cb8845a06/cf, FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d88fb3a97933fbe0f2d2885cb8845a06/recovered.edits] 2023-07-15 03:12:36,352 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:36,352 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:36,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-15 03:12:36,352 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:36,355 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:36,357 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9ccb00eb8931fee23a9c67db54e35044/cf/ae9e89a8b4b446ee85965935191c3924 to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9ccb00eb8931fee23a9c67db54e35044/cf/ae9e89a8b4b446ee85965935191c3924 2023-07-15 03:12:36,358 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d88fb3a97933fbe0f2d2885cb8845a06/cf/b7cf5a65b7f1470bb73aae180f1e8dfe to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d88fb3a97933fbe0f2d2885cb8845a06/cf/b7cf5a65b7f1470bb73aae180f1e8dfe 2023-07-15 03:12:36,358 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7b1a169d88a04ba673b87c02f178f461/cf/ae9e89a8b4b446ee85965935191c3924.9ccb00eb8931fee23a9c67db54e35044 to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7b1a169d88a04ba673b87c02f178f461/cf/ae9e89a8b4b446ee85965935191c3924.9ccb00eb8931fee23a9c67db54e35044 2023-07-15 03:12:36,360 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7b1a169d88a04ba673b87c02f178f461/cf/b7cf5a65b7f1470bb73aae180f1e8dfe.d88fb3a97933fbe0f2d2885cb8845a06 to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7b1a169d88a04ba673b87c02f178f461/cf/b7cf5a65b7f1470bb73aae180f1e8dfe.d88fb3a97933fbe0f2d2885cb8845a06 2023-07-15 03:12:36,362 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9ccb00eb8931fee23a9c67db54e35044/recovered.edits/8.seqid to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9ccb00eb8931fee23a9c67db54e35044/recovered.edits/8.seqid 2023-07-15 03:12:36,363 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9ccb00eb8931fee23a9c67db54e35044 2023-07-15 03:12:36,363 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d88fb3a97933fbe0f2d2885cb8845a06/recovered.edits/8.seqid to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d88fb3a97933fbe0f2d2885cb8845a06/recovered.edits/8.seqid 2023-07-15 03:12:36,363 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d88fb3a97933fbe0f2d2885cb8845a06 2023-07-15 03:12:36,364 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7b1a169d88a04ba673b87c02f178f461/recovered.edits/12.seqid to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7b1a169d88a04ba673b87c02f178f461/recovered.edits/12.seqid 2023-07-15 03:12:36,365 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7b1a169d88a04ba673b87c02f178f461 2023-07-15 03:12:36,365 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-15 03:12:36,367 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:36,370 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-15 03:12:36,373 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-15 03:12:36,374 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:36,374 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-15 03:12:36,375 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733973.7b1a169d88a04ba673b87c02f178f461.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689390756374"}]},"ts":"9223372036854775807"} 2023-07-15 03:12:36,376 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-15 03:12:36,377 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7b1a169d88a04ba673b87c02f178f461, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689390733973.7b1a169d88a04ba673b87c02f178f461.', STARTKEY => '', ENDKEY => ''}] 2023-07-15 03:12:36,377 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-15 03:12:36,377 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689390756377"}]},"ts":"9223372036854775807"} 2023-07-15 03:12:36,390 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-15 03:12:36,398 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:36,400 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 60 msec 2023-07-15 03:12:36,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-15 03:12:36,456 INFO [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-15 03:12:36,457 INFO [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:36,457 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:36,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:36,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-15 03:12:36,462 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390756462"}]},"ts":"1689390756462"} 2023-07-15 03:12:36,464 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-15 03:12:36,466 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-15 03:12:36,467 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=41994ad6237867e7977d3e3c147a35d5, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=87b0cfb7e10b096645ab55a1fdd3cb49, UNASSIGN}] 2023-07-15 03:12:36,476 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=41994ad6237867e7977d3e3c147a35d5, UNASSIGN 2023-07-15 03:12:36,476 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=87b0cfb7e10b096645ab55a1fdd3cb49, UNASSIGN 2023-07-15 03:12:36,477 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=41994ad6237867e7977d3e3c147a35d5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:36,478 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689390731387.41994ad6237867e7977d3e3c147a35d5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689390756477"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390756477"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390756477"}]},"ts":"1689390756477"} 2023-07-15 03:12:36,479 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=87b0cfb7e10b096645ab55a1fdd3cb49, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:36,479 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689390731387.87b0cfb7e10b096645ab55a1fdd3cb49.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689390756479"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390756479"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390756479"}]},"ts":"1689390756479"} 2023-07-15 03:12:36,480 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 41994ad6237867e7977d3e3c147a35d5, server=jenkins-hbase4.apache.org,40245,1689390651089}] 2023-07-15 03:12:36,482 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 87b0cfb7e10b096645ab55a1fdd3cb49, server=jenkins-hbase4.apache.org,37439,1689390651159}] 2023-07-15 03:12:36,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-15 03:12:36,633 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 41994ad6237867e7977d3e3c147a35d5 2023-07-15 03:12:36,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 41994ad6237867e7977d3e3c147a35d5, disabling compactions & flushes 2023-07-15 03:12:36,634 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689390731387.41994ad6237867e7977d3e3c147a35d5. 2023-07-15 03:12:36,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689390731387.41994ad6237867e7977d3e3c147a35d5. 2023-07-15 03:12:36,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689390731387.41994ad6237867e7977d3e3c147a35d5. after waiting 0 ms 2023-07-15 03:12:36,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689390731387.41994ad6237867e7977d3e3c147a35d5. 2023-07-15 03:12:36,638 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 87b0cfb7e10b096645ab55a1fdd3cb49 2023-07-15 03:12:36,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 87b0cfb7e10b096645ab55a1fdd3cb49, disabling compactions & flushes 2023-07-15 03:12:36,638 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689390731387.87b0cfb7e10b096645ab55a1fdd3cb49. 2023-07-15 03:12:36,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689390731387.87b0cfb7e10b096645ab55a1fdd3cb49. 2023-07-15 03:12:36,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689390731387.87b0cfb7e10b096645ab55a1fdd3cb49. after waiting 0 ms 2023-07-15 03:12:36,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689390731387.87b0cfb7e10b096645ab55a1fdd3cb49. 2023-07-15 03:12:36,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion/41994ad6237867e7977d3e3c147a35d5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 03:12:36,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithMergeRegion/87b0cfb7e10b096645ab55a1fdd3cb49/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 03:12:36,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:12:36,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:12:36,649 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689390731387.41994ad6237867e7977d3e3c147a35d5. 2023-07-15 03:12:36,650 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689390731387.87b0cfb7e10b096645ab55a1fdd3cb49. 2023-07-15 03:12:36,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 41994ad6237867e7977d3e3c147a35d5: 2023-07-15 03:12:36,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 87b0cfb7e10b096645ab55a1fdd3cb49: 2023-07-15 03:12:36,651 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 41994ad6237867e7977d3e3c147a35d5 2023-07-15 03:12:36,652 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=41994ad6237867e7977d3e3c147a35d5, regionState=CLOSED 2023-07-15 03:12:36,652 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 87b0cfb7e10b096645ab55a1fdd3cb49 2023-07-15 03:12:36,652 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689390731387.41994ad6237867e7977d3e3c147a35d5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689390756652"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390756652"}]},"ts":"1689390756652"} 2023-07-15 03:12:36,653 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=87b0cfb7e10b096645ab55a1fdd3cb49, regionState=CLOSED 2023-07-15 03:12:36,654 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689390731387.87b0cfb7e10b096645ab55a1fdd3cb49.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689390756653"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390756653"}]},"ts":"1689390756653"} 2023-07-15 03:12:36,655 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-15 03:12:36,655 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 41994ad6237867e7977d3e3c147a35d5, server=jenkins-hbase4.apache.org,40245,1689390651089 in 173 msec 2023-07-15 03:12:36,656 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=41994ad6237867e7977d3e3c147a35d5, UNASSIGN in 188 msec 2023-07-15 03:12:36,657 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-15 03:12:36,657 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 87b0cfb7e10b096645ab55a1fdd3cb49, server=jenkins-hbase4.apache.org,37439,1689390651159 in 173 msec 2023-07-15 03:12:36,658 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-15 03:12:36,658 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=87b0cfb7e10b096645ab55a1fdd3cb49, UNASSIGN in 190 msec 2023-07-15 03:12:36,659 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390756659"}]},"ts":"1689390756659"} 2023-07-15 03:12:36,660 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-15 03:12:36,662 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-15 03:12:36,667 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 209 msec 2023-07-15 03:12:36,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-15 03:12:36,765 INFO [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-15 03:12:36,765 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:36,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:36,769 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:36,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:36,770 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:36,771 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43379] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:36,775 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/41994ad6237867e7977d3e3c147a35d5 2023-07-15 03:12:36,778 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:36,778 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:36,778 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:36,778 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:36,779 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/41994ad6237867e7977d3e3c147a35d5/cf, FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/41994ad6237867e7977d3e3c147a35d5/recovered.edits] 2023-07-15 03:12:36,779 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-15 03:12:36,779 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-15 03:12:36,779 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/87b0cfb7e10b096645ab55a1fdd3cb49 2023-07-15 03:12:36,779 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-15 03:12:36,779 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-15 03:12:36,781 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:36,781 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:36,781 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:36,781 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:36,781 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:36,781 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:36,781 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:36,781 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:36,784 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/87b0cfb7e10b096645ab55a1fdd3cb49/cf, FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/87b0cfb7e10b096645ab55a1fdd3cb49/recovered.edits] 2023-07-15 03:12:36,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-15 03:12:36,789 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/41994ad6237867e7977d3e3c147a35d5/cf/bc994ba9457647fb8f5eac2daa2ecec4 to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/41994ad6237867e7977d3e3c147a35d5/cf/bc994ba9457647fb8f5eac2daa2ecec4 2023-07-15 03:12:36,791 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/87b0cfb7e10b096645ab55a1fdd3cb49/cf/8f0b3e4038064b5d9f9cc3e7fb787a0f to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/87b0cfb7e10b096645ab55a1fdd3cb49/cf/8f0b3e4038064b5d9f9cc3e7fb787a0f 2023-07-15 03:12:36,794 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/41994ad6237867e7977d3e3c147a35d5/recovered.edits/9.seqid to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/41994ad6237867e7977d3e3c147a35d5/recovered.edits/9.seqid 2023-07-15 03:12:36,795 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/41994ad6237867e7977d3e3c147a35d5 2023-07-15 03:12:36,796 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/87b0cfb7e10b096645ab55a1fdd3cb49/recovered.edits/9.seqid to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/87b0cfb7e10b096645ab55a1fdd3cb49/recovered.edits/9.seqid 2023-07-15 03:12:36,796 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/87b0cfb7e10b096645ab55a1fdd3cb49 2023-07-15 03:12:36,797 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-15 03:12:36,797 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-15 03:12:36,798 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-15 03:12:36,803 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307152d87bf4fb7f9402c84e31f3c7e3c1b2f to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307152d87bf4fb7f9402c84e31f3c7e3c1b2f 2023-07-15 03:12:36,805 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230715c7e5dc4775384bbb8a2d29e911d3b738 to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230715c7e5dc4775384bbb8a2d29e911d3b738 2023-07-15 03:12:36,805 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-15 03:12:36,808 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:36,814 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-15 03:12:36,821 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-15 03:12:36,823 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:36,823 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-15 03:12:36,823 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689390731387.41994ad6237867e7977d3e3c147a35d5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689390756823"}]},"ts":"9223372036854775807"} 2023-07-15 03:12:36,823 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689390731387.87b0cfb7e10b096645ab55a1fdd3cb49.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689390756823"}]},"ts":"9223372036854775807"} 2023-07-15 03:12:36,825 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 03:12:36,825 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 41994ad6237867e7977d3e3c147a35d5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689390731387.41994ad6237867e7977d3e3c147a35d5.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 87b0cfb7e10b096645ab55a1fdd3cb49, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689390731387.87b0cfb7e10b096645ab55a1fdd3cb49.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 03:12:36,825 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-15 03:12:36,825 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689390756825"}]},"ts":"9223372036854775807"} 2023-07-15 03:12:36,827 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-15 03:12:36,830 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:36,831 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 65 msec 2023-07-15 03:12:36,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-15 03:12:36,887 INFO [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-15 03:12:36,897 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-15 03:12:36,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:36,901 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-15 03:12:36,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 03:12:36,904 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-15 03:12:36,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 03:12:36,939 INFO [Listener at jenkins-hbase4.apache.org/35095] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=758 (was 745) Potentially hanging thread: IPC Client (1575588394) connection to jenkins-hbase4.apache.org/172.31.14.131:33403 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x2eee99d1-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_351679589_17 at /127.0.0.1:43180 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_351679589_17 at /127.0.0.1:55004 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4223 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x2eee99d1-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_351679589_17 at /127.0.0.1:43924 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1842874074_1 at /127.0.0.1:43154 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2eee99d1-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2eee99d1-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2eee99d1-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2eee99d1-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=904 (was 896) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=600 (was 360) - SystemLoadAverage LEAK? -, ProcessCount=186 (was 183) - ProcessCount LEAK? -, AvailableMemoryMB=1690 (was 2705) 2023-07-15 03:12:36,939 WARN [Listener at jenkins-hbase4.apache.org/35095] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-15 03:12:36,960 INFO [Listener at jenkins-hbase4.apache.org/35095] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=758, OpenFileDescriptor=904, MaxFileDescriptor=60000, SystemLoadAverage=600, ProcessCount=186, AvailableMemoryMB=1689 2023-07-15 03:12:36,960 WARN [Listener at jenkins-hbase4.apache.org/35095] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-15 03:12:36,962 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-15 03:12:36,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 03:12:36,965 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 03:12:36,965 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-15 03:12:36,966 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 03:12:36,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-15 03:12:36,968 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testEmptyExportFileSystemState/5a5a6b11abe9541fb5d68f6563ea5acb 2023-07-15 03:12:36,968 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testEmptyExportFileSystemState/338ff62b94a1e59aa6e6313ac9092d01 2023-07-15 03:12:36,969 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testEmptyExportFileSystemState/5a5a6b11abe9541fb5d68f6563ea5acb empty. 2023-07-15 03:12:36,969 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testEmptyExportFileSystemState/338ff62b94a1e59aa6e6313ac9092d01 empty. 2023-07-15 03:12:36,970 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testEmptyExportFileSystemState/5a5a6b11abe9541fb5d68f6563ea5acb 2023-07-15 03:12:36,970 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testEmptyExportFileSystemState/338ff62b94a1e59aa6e6313ac9092d01 2023-07-15 03:12:36,970 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-15 03:12:37,000 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-15 03:12:37,002 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5a5a6b11abe9541fb5d68f6563ea5acb, NAME => 'testtb-testEmptyExportFileSystemState,,1689390756962.5a5a6b11abe9541fb5d68f6563ea5acb.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp 2023-07-15 03:12:37,002 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 338ff62b94a1e59aa6e6313ac9092d01, NAME => 'testtb-testEmptyExportFileSystemState,1,1689390756962.338ff62b94a1e59aa6e6313ac9092d01.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp 2023-07-15 03:12:37,056 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689390756962.338ff62b94a1e59aa6e6313ac9092d01.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:12:37,056 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 338ff62b94a1e59aa6e6313ac9092d01, disabling compactions & flushes 2023-07-15 03:12:37,056 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689390756962.338ff62b94a1e59aa6e6313ac9092d01. 2023-07-15 03:12:37,056 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689390756962.338ff62b94a1e59aa6e6313ac9092d01. 2023-07-15 03:12:37,056 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689390756962.338ff62b94a1e59aa6e6313ac9092d01. after waiting 0 ms 2023-07-15 03:12:37,056 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689390756962.338ff62b94a1e59aa6e6313ac9092d01. 2023-07-15 03:12:37,056 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689390756962.338ff62b94a1e59aa6e6313ac9092d01. 2023-07-15 03:12:37,056 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 338ff62b94a1e59aa6e6313ac9092d01: 2023-07-15 03:12:37,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-15 03:12:37,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-15 03:12:37,457 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689390756962.5a5a6b11abe9541fb5d68f6563ea5acb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:12:37,457 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 5a5a6b11abe9541fb5d68f6563ea5acb, disabling compactions & flushes 2023-07-15 03:12:37,457 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689390756962.5a5a6b11abe9541fb5d68f6563ea5acb. 2023-07-15 03:12:37,457 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689390756962.5a5a6b11abe9541fb5d68f6563ea5acb. 2023-07-15 03:12:37,457 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689390756962.5a5a6b11abe9541fb5d68f6563ea5acb. after waiting 0 ms 2023-07-15 03:12:37,457 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689390756962.5a5a6b11abe9541fb5d68f6563ea5acb. 2023-07-15 03:12:37,457 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689390756962.5a5a6b11abe9541fb5d68f6563ea5acb. 2023-07-15 03:12:37,457 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 5a5a6b11abe9541fb5d68f6563ea5acb: 2023-07-15 03:12:37,463 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 03:12:37,464 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689390756962.338ff62b94a1e59aa6e6313ac9092d01.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689390757464"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390757464"}]},"ts":"1689390757464"} 2023-07-15 03:12:37,464 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689390756962.5a5a6b11abe9541fb5d68f6563ea5acb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689390757464"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390757464"}]},"ts":"1689390757464"} 2023-07-15 03:12:37,471 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 03:12:37,472 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 03:12:37,472 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390757472"}]},"ts":"1689390757472"} 2023-07-15 03:12:37,473 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-15 03:12:37,476 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 03:12:37,477 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 03:12:37,478 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 03:12:37,478 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 03:12:37,478 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 03:12:37,478 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5a5a6b11abe9541fb5d68f6563ea5acb, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=338ff62b94a1e59aa6e6313ac9092d01, ASSIGN}] 2023-07-15 03:12:37,481 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=338ff62b94a1e59aa6e6313ac9092d01, ASSIGN 2023-07-15 03:12:37,481 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5a5a6b11abe9541fb5d68f6563ea5acb, ASSIGN 2023-07-15 03:12:37,482 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5a5a6b11abe9541fb5d68f6563ea5acb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40245,1689390651089; forceNewPlan=false, retain=false 2023-07-15 03:12:37,482 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=338ff62b94a1e59aa6e6313ac9092d01, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37439,1689390651159; forceNewPlan=false, retain=false 2023-07-15 03:12:37,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-15 03:12:37,632 INFO [jenkins-hbase4:45731] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 03:12:37,635 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=5a5a6b11abe9541fb5d68f6563ea5acb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:37,635 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=338ff62b94a1e59aa6e6313ac9092d01, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:37,635 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689390756962.5a5a6b11abe9541fb5d68f6563ea5acb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689390757635"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390757635"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390757635"}]},"ts":"1689390757635"} 2023-07-15 03:12:37,635 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689390756962.338ff62b94a1e59aa6e6313ac9092d01.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689390757635"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390757635"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390757635"}]},"ts":"1689390757635"} 2023-07-15 03:12:37,641 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 5a5a6b11abe9541fb5d68f6563ea5acb, server=jenkins-hbase4.apache.org,40245,1689390651089}] 2023-07-15 03:12:37,641 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 338ff62b94a1e59aa6e6313ac9092d01, server=jenkins-hbase4.apache.org,37439,1689390651159}] 2023-07-15 03:12:37,796 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689390756962.5a5a6b11abe9541fb5d68f6563ea5acb. 2023-07-15 03:12:37,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5a5a6b11abe9541fb5d68f6563ea5acb, NAME => 'testtb-testEmptyExportFileSystemState,,1689390756962.5a5a6b11abe9541fb5d68f6563ea5acb.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 03:12:37,797 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689390756962.338ff62b94a1e59aa6e6313ac9092d01. 2023-07-15 03:12:37,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689390756962.5a5a6b11abe9541fb5d68f6563ea5acb. service=AccessControlService 2023-07-15 03:12:37,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 338ff62b94a1e59aa6e6313ac9092d01, NAME => 'testtb-testEmptyExportFileSystemState,1,1689390756962.338ff62b94a1e59aa6e6313ac9092d01.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 03:12:37,797 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 03:12:37,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689390756962.338ff62b94a1e59aa6e6313ac9092d01. service=AccessControlService 2023-07-15 03:12:37,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 5a5a6b11abe9541fb5d68f6563ea5acb 2023-07-15 03:12:37,797 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 03:12:37,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689390756962.5a5a6b11abe9541fb5d68f6563ea5acb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:12:37,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 338ff62b94a1e59aa6e6313ac9092d01 2023-07-15 03:12:37,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5a5a6b11abe9541fb5d68f6563ea5acb 2023-07-15 03:12:37,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689390756962.338ff62b94a1e59aa6e6313ac9092d01.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:12:37,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5a5a6b11abe9541fb5d68f6563ea5acb 2023-07-15 03:12:37,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 338ff62b94a1e59aa6e6313ac9092d01 2023-07-15 03:12:37,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 338ff62b94a1e59aa6e6313ac9092d01 2023-07-15 03:12:37,799 INFO [StoreOpener-5a5a6b11abe9541fb5d68f6563ea5acb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5a5a6b11abe9541fb5d68f6563ea5acb 2023-07-15 03:12:37,799 INFO [StoreOpener-338ff62b94a1e59aa6e6313ac9092d01-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 338ff62b94a1e59aa6e6313ac9092d01 2023-07-15 03:12:37,800 DEBUG [StoreOpener-5a5a6b11abe9541fb5d68f6563ea5acb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testEmptyExportFileSystemState/5a5a6b11abe9541fb5d68f6563ea5acb/cf 2023-07-15 03:12:37,801 DEBUG [StoreOpener-5a5a6b11abe9541fb5d68f6563ea5acb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testEmptyExportFileSystemState/5a5a6b11abe9541fb5d68f6563ea5acb/cf 2023-07-15 03:12:37,801 DEBUG [StoreOpener-338ff62b94a1e59aa6e6313ac9092d01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testEmptyExportFileSystemState/338ff62b94a1e59aa6e6313ac9092d01/cf 2023-07-15 03:12:37,801 DEBUG [StoreOpener-338ff62b94a1e59aa6e6313ac9092d01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testEmptyExportFileSystemState/338ff62b94a1e59aa6e6313ac9092d01/cf 2023-07-15 03:12:37,801 INFO [StoreOpener-5a5a6b11abe9541fb5d68f6563ea5acb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5a5a6b11abe9541fb5d68f6563ea5acb columnFamilyName cf 2023-07-15 03:12:37,801 INFO [StoreOpener-338ff62b94a1e59aa6e6313ac9092d01-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 338ff62b94a1e59aa6e6313ac9092d01 columnFamilyName cf 2023-07-15 03:12:37,802 INFO [StoreOpener-338ff62b94a1e59aa6e6313ac9092d01-1] regionserver.HStore(310): Store=338ff62b94a1e59aa6e6313ac9092d01/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:12:37,803 INFO [StoreOpener-5a5a6b11abe9541fb5d68f6563ea5acb-1] regionserver.HStore(310): Store=5a5a6b11abe9541fb5d68f6563ea5acb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:12:37,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testEmptyExportFileSystemState/338ff62b94a1e59aa6e6313ac9092d01 2023-07-15 03:12:37,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testEmptyExportFileSystemState/5a5a6b11abe9541fb5d68f6563ea5acb 2023-07-15 03:12:37,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testEmptyExportFileSystemState/5a5a6b11abe9541fb5d68f6563ea5acb 2023-07-15 03:12:37,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testEmptyExportFileSystemState/338ff62b94a1e59aa6e6313ac9092d01 2023-07-15 03:12:37,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5a5a6b11abe9541fb5d68f6563ea5acb 2023-07-15 03:12:37,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 338ff62b94a1e59aa6e6313ac9092d01 2023-07-15 03:12:37,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testEmptyExportFileSystemState/5a5a6b11abe9541fb5d68f6563ea5acb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 03:12:37,810 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5a5a6b11abe9541fb5d68f6563ea5acb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74109960, jitterRate=0.10432446002960205}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 03:12:37,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5a5a6b11abe9541fb5d68f6563ea5acb: 2023-07-15 03:12:37,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testEmptyExportFileSystemState/338ff62b94a1e59aa6e6313ac9092d01/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 03:12:37,811 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 338ff62b94a1e59aa6e6313ac9092d01; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71820556, jitterRate=0.07020968198776245}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 03:12:37,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 338ff62b94a1e59aa6e6313ac9092d01: 2023-07-15 03:12:37,815 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689390756962.5a5a6b11abe9541fb5d68f6563ea5acb., pid=93, masterSystemTime=1689390757793 2023-07-15 03:12:37,815 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689390756962.338ff62b94a1e59aa6e6313ac9092d01., pid=94, masterSystemTime=1689390757793 2023-07-15 03:12:37,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689390756962.5a5a6b11abe9541fb5d68f6563ea5acb. 2023-07-15 03:12:37,817 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689390756962.5a5a6b11abe9541fb5d68f6563ea5acb. 2023-07-15 03:12:37,818 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=5a5a6b11abe9541fb5d68f6563ea5acb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:37,818 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689390756962.5a5a6b11abe9541fb5d68f6563ea5acb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689390757817"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689390757817"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689390757817"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689390757817"}]},"ts":"1689390757817"} 2023-07-15 03:12:37,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689390756962.338ff62b94a1e59aa6e6313ac9092d01. 2023-07-15 03:12:37,819 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689390756962.338ff62b94a1e59aa6e6313ac9092d01. 2023-07-15 03:12:37,822 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=338ff62b94a1e59aa6e6313ac9092d01, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:37,822 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689390756962.338ff62b94a1e59aa6e6313ac9092d01.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689390757822"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689390757822"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689390757822"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689390757822"}]},"ts":"1689390757822"} 2023-07-15 03:12:37,825 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-15 03:12:37,825 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 5a5a6b11abe9541fb5d68f6563ea5acb, server=jenkins-hbase4.apache.org,40245,1689390651089 in 181 msec 2023-07-15 03:12:37,829 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-15 03:12:37,829 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5a5a6b11abe9541fb5d68f6563ea5acb, ASSIGN in 347 msec 2023-07-15 03:12:37,829 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 338ff62b94a1e59aa6e6313ac9092d01, server=jenkins-hbase4.apache.org,37439,1689390651159 in 183 msec 2023-07-15 03:12:37,831 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-15 03:12:37,831 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=338ff62b94a1e59aa6e6313ac9092d01, ASSIGN in 351 msec 2023-07-15 03:12:37,831 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 03:12:37,831 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390757831"}]},"ts":"1689390757831"} 2023-07-15 03:12:37,833 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-15 03:12:37,836 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 03:12:37,837 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-15 03:12:37,839 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43379] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 03:12:37,840 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:37,840 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:37,840 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:37,840 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:37,842 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:37,842 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:37,842 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:37,842 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:37,843 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 880 msec 2023-07-15 03:12:38,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-15 03:12:38,072 INFO [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-15 03:12:38,075 DEBUG [Listener at jenkins-hbase4.apache.org/35095] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-15 03:12:38,075 DEBUG [Listener at jenkins-hbase4.apache.org/35095] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689390756962.5a5a6b11abe9541fb5d68f6563ea5acb. 2023-07-15 03:12:38,077 INFO [Listener at jenkins-hbase4.apache.org/35095] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 03:12:38,090 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 03:12:38,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689390758090 (current time:1689390758090). 2023-07-15 03:12:38,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 03:12:38,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(139): Connect 0x04b8fb34 to 127.0.0.1:58749 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:12:38,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e659ff0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:12:38,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:12:38,108 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47536, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:12:38,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x04b8fb34 to 127.0.0.1:58749 2023-07-15 03:12:38,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:12:38,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(139): Connect 0x4af95c22 to 127.0.0.1:58749 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:12:38,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@95b7f12, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:12:38,120 DEBUG [hconnection-0x1bd3fbd6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:12:38,122 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47538, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:12:38,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:12:38,129 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55700, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:12:38,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4af95c22 to 127.0.0.1:58749 2023-07-15 03:12:38,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:12:38,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 03:12:38,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 03:12:38,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 03:12:38,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 03:12:38,134 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 03:12:38,135 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689391358135 2023-07-15 03:12:38,135 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-15 03:12:38,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 03:12:38,136 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 03:12:38,137 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 03:12:38,138 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 03:12:38,138 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 03:12:38,139 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-15 03:12:38,142 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 03:12:38,142 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689391358142 2023-07-15 03:12:38,156 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,156 INFO [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-15 03:12:38,156 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:38,157 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-15 03:12:38,157 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-15 03:12:38,158 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,158 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,162 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:38,162 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:38,162 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:38,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:38,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:38,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:38,162 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:38,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:38,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:38,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:38,163 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:38,163 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:38,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,163 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-15 03:12:38,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,164 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 03:12:38,164 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,164 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 03:12:38,164 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:38,165 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 03:12:38,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,166 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 03:12:38,166 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40245,1689390651089' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 03:12:38,166 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,166 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-15 03:12:38,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-15 03:12:38,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,167 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 03:12:38,167 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 03:12:38,168 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,168 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:38,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:38,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:38,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:38,168 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,168 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:12:38,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:38,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:38,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:38,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:38,170 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40245,1689390651089' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-15 03:12:38,170 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,170 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@718d311b[Count = 1] remaining members to acquire global barrier 2023-07-15 03:12:38,171 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 03:12:38,171 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:38,173 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:38,173 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 03:12:38,178 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 03:12:38,178 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,178 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 03:12:38,179 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 03:12:38,179 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:38,179 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37439,1689390651159' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 03:12:38,180 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 03:12:38,180 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 03:12:38,180 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43379,1689390651212' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 03:12:38,182 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:38,182 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:38,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:38,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:38,182 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,183 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,183 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:12:38,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:38,183 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,183 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:12:38,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:38,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:38,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:38,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:38,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:38,185 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37439,1689390651159' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-15 03:12:38,185 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@718d311b[Count = 0] remaining members to acquire global barrier 2023-07-15 03:12:38,185 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-15 03:12:38,185 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,187 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,187 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,187 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:38,187 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 03:12:38,187 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 03:12:38,187 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 03:12:38,187 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43379,1689390651212' in zk 2023-07-15 03:12:38,188 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:38,188 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 03:12:38,190 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 03:12:38,190 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:38,190 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 03:12:38,190 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:12:38,191 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:12:38,191 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,191 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689390756962.338ff62b94a1e59aa6e6313ac9092d01. 2023-07-15 03:12:38,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,191 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689390756962.338ff62b94a1e59aa6e6313ac9092d01. started... 2023-07-15 03:12:38,191 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 03:12:38,191 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:12:38,193 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:12:38,193 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 338ff62b94a1e59aa6e6313ac9092d01: 2023-07-15 03:12:38,193 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689390756962.5a5a6b11abe9541fb5d68f6563ea5acb. 2023-07-15 03:12:38,193 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689390756962.5a5a6b11abe9541fb5d68f6563ea5acb. started... 2023-07-15 03:12:38,193 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689390756962.338ff62b94a1e59aa6e6313ac9092d01.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,193 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:12:38,193 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5a5a6b11abe9541fb5d68f6563ea5acb: 2023-07-15 03:12:38,193 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 03:12:38,193 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689390756962.5a5a6b11abe9541fb5d68f6563ea5acb.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,193 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:12:38,194 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 03:12:38,235 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689390756962.338ff62b94a1e59aa6e6313ac9092d01. completed. 2023-07-15 03:12:38,236 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689390756962.338ff62b94a1e59aa6e6313ac9092d01. 2023-07-15 03:12:38,236 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:12:38,236 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:12:38,236 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:38,236 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 03:12:38,236 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37439,1689390651159' in zk 2023-07-15 03:12:38,236 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689390756962.5a5a6b11abe9541fb5d68f6563ea5acb. completed. 2023-07-15 03:12:38,236 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689390756962.5a5a6b11abe9541fb5d68f6563ea5acb. 2023-07-15 03:12:38,236 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:12:38,236 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:12:38,236 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:38,236 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 03:12:38,236 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40245,1689390651089' in zk 2023-07-15 03:12:38,237 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:12:38,238 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:38,238 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 03:12:38,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 03:12:38,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:38,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:38,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:38,238 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:38,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 03:12:38,238 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 03:12:38,240 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 03:12:38,240 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 03:12:38,240 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:38,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:38,240 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:38,240 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 03:12:38,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:38,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:38,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:38,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:38,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:38,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:38,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:38,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:38,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37439,1689390651159': 2023-07-15 03:12:38,245 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37439,1689390651159' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-15 03:12:38,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:38,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:38,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:38,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:38,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:38,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:38,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:38,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:38,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:38,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:38,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:38,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:38,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40245,1689390651089': 2023-07-15 03:12:38,248 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40245,1689390651089' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-15 03:12:38,248 INFO [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-15 03:12:38,249 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 03:12:38,249 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 03:12:38,249 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,249 INFO [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 03:12:38,250 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,250 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,250 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:38,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,250 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,250 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:38,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,251 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:38,251 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:38,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:38,251 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:38,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:38,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:38,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:38,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:38,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:38,252 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:38,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:38,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:38,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,253 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:38,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:38,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:38,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:38,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:38,255 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:38,255 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:38,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:38,256 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:38,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:38,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:38,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:38,260 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:38,260 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:38,260 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:38,260 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:38,260 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:38,260 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,260 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:38,260 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:38,260 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:38,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:38,260 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:38,260 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-15 03:12:38,260 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,260 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:38,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:38,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:38,261 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,261 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:38,262 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 03:12:38,262 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:38,261 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:38,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:38,262 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:38,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:38,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:38,262 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:38,262 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,263 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:38,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:38,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:38,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:38,263 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-15 03:12:38,274 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,274 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,327 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,396 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-15 03:12:38,397 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,397 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,397 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689390758135Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689390758274 (+139 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689390758274Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689390758274Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689390758289 (+15 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689390758319 (+30 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689390758396 (+77 ms) 2023-07-15 03:12:38,401 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 03:12:38,403 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 265 msec 2023-07-15 03:12:38,440 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:12:38,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 03:12:38,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 03:12:38,450 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40245] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689390756962.5a5a6b11abe9541fb5d68f6563ea5acb. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 03:12:38,451 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37439] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689390756962.338ff62b94a1e59aa6e6313ac9092d01. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 03:12:38,454 DEBUG [Listener at jenkins-hbase4.apache.org/35095] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-15 03:12:38,454 DEBUG [Listener at jenkins-hbase4.apache.org/35095] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689390756962.5a5a6b11abe9541fb5d68f6563ea5acb. 2023-07-15 03:12:38,454 INFO [Listener at jenkins-hbase4.apache.org/35095] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 03:12:38,469 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 03:12:38,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689390758469 (current time:1689390758469). 2023-07-15 03:12:38,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 03:12:38,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(139): Connect 0x2615ba20 to 127.0.0.1:58749 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:12:38,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@229cf87f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:12:38,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:12:38,505 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47550, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:12:38,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2615ba20 to 127.0.0.1:58749 2023-07-15 03:12:38,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:12:38,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(139): Connect 0x6011f7f3 to 127.0.0.1:58749 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:12:38,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b5e856b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:12:38,526 DEBUG [hconnection-0x2e44c77f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:12:38,527 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47562, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:12:38,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:12:38,541 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55716, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:12:38,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6011f7f3 to 127.0.0.1:58749 2023-07-15 03:12:38,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:12:38,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 03:12:38,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 03:12:38,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 03:12:38,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 03:12:38,547 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 03:12:38,549 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689391358549 2023-07-15 03:12:38,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 03:12:38,549 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-15 03:12:38,550 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 03:12:38,550 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 03:12:38,552 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 03:12:38,552 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 03:12:38,552 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-15 03:12:38,553 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 03:12:38,554 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689391358554 2023-07-15 03:12:38,600 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,600 INFO [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-15 03:12:38,600 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:38,601 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-15 03:12:38,601 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-15 03:12:38,602 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,602 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,603 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:38,603 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:38,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:38,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:38,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:38,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:38,603 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:38,603 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:38,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:38,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:38,604 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-15 03:12:38,605 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,605 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 03:12:38,605 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:38,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-15 03:12:38,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,606 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 03:12:38,606 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-15 03:12:38,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,606 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 03:12:38,606 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,607 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 03:12:38,607 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:38,607 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,605 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:38,607 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 03:12:38,607 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,608 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:38,609 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 03:12:38,608 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 03:12:38,610 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:38,610 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 03:12:38,613 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 03:12:38,613 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40245,1689390651089' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 03:12:38,613 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 03:12:38,615 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 03:12:38,615 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37439,1689390651159' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 03:12:38,610 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 03:12:38,615 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43379,1689390651212' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 03:12:38,615 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:38,615 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 03:12:38,625 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,625 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,625 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,625 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:38,625 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:38,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:38,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:38,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:38,625 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,625 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,625 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:12:38,625 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:12:38,625 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,625 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:12:38,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:38,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:38,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:38,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:38,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:38,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:38,628 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37439,1689390651159' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-15 03:12:38,628 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@35a11f42[Count = 1] remaining members to acquire global barrier 2023-07-15 03:12:38,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:38,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:38,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:38,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:38,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:38,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:38,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:38,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:38,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:38,630 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40245,1689390651089' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-15 03:12:38,630 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@35a11f42[Count = 0] remaining members to acquire global barrier 2023-07-15 03:12:38,630 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-15 03:12:38,630 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,634 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,634 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,634 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,635 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 03:12:38,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,635 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 03:12:38,635 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:12:38,635 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:12:38,635 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689390756962.5a5a6b11abe9541fb5d68f6563ea5acb. 2023-07-15 03:12:38,635 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:38,635 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689390756962.5a5a6b11abe9541fb5d68f6563ea5acb. started... 2023-07-15 03:12:38,635 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 03:12:38,635 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 03:12:38,635 INFO [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5a5a6b11abe9541fb5d68f6563ea5acb 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-15 03:12:38,635 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43379,1689390651212' in zk 2023-07-15 03:12:38,635 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:38,635 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 03:12:38,635 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:12:38,635 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689390756962.338ff62b94a1e59aa6e6313ac9092d01. 2023-07-15 03:12:38,635 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:12:38,635 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689390756962.338ff62b94a1e59aa6e6313ac9092d01. started... 2023-07-15 03:12:38,636 INFO [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 338ff62b94a1e59aa6e6313ac9092d01 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-15 03:12:38,637 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 03:12:38,637 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:38,637 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 03:12:38,651 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:12:38,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 03:12:38,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 03:12:38,652 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 03:12:38,683 INFO [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230715d121f9bea11341d3ad60d4ea0c7ce511 to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230715d121f9bea11341d3ad60d4ea0c7ce511 2023-07-15 03:12:38,690 INFO [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230715370705d848be490cbcd97e8fef5dd78a to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230715370705d848be490cbcd97e8fef5dd78a 2023-07-15 03:12:38,714 INFO [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testEmptyExportFileSystemState/5a5a6b11abe9541fb5d68f6563ea5acb/.tmp/cf/cb18745afc2e41f8b3cfa6c8ef464c23 2023-07-15 03:12:38,727 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testEmptyExportFileSystemState/5a5a6b11abe9541fb5d68f6563ea5acb/.tmp/cf/cb18745afc2e41f8b3cfa6c8ef464c23 as hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testEmptyExportFileSystemState/5a5a6b11abe9541fb5d68f6563ea5acb/cf/cb18745afc2e41f8b3cfa6c8ef464c23 2023-07-15 03:12:38,729 INFO [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testEmptyExportFileSystemState/338ff62b94a1e59aa6e6313ac9092d01/.tmp/cf/e03b0824ae9d4099855fe3d79bc22deb 2023-07-15 03:12:38,734 INFO [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testEmptyExportFileSystemState/5a5a6b11abe9541fb5d68f6563ea5acb/cf/cb18745afc2e41f8b3cfa6c8ef464c23, entries=4, sequenceid=6, filesize=5.6 K 2023-07-15 03:12:38,735 INFO [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 5a5a6b11abe9541fb5d68f6563ea5acb in 100ms, sequenceid=6, compaction requested=false 2023-07-15 03:12:38,735 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-15 03:12:38,735 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testEmptyExportFileSystemState/338ff62b94a1e59aa6e6313ac9092d01/.tmp/cf/e03b0824ae9d4099855fe3d79bc22deb as hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testEmptyExportFileSystemState/338ff62b94a1e59aa6e6313ac9092d01/cf/e03b0824ae9d4099855fe3d79bc22deb 2023-07-15 03:12:38,736 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5a5a6b11abe9541fb5d68f6563ea5acb: 2023-07-15 03:12:38,736 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689390756962.5a5a6b11abe9541fb5d68f6563ea5acb.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,736 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:12:38,737 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testEmptyExportFileSystemState/5a5a6b11abe9541fb5d68f6563ea5acb/cf/cb18745afc2e41f8b3cfa6c8ef464c23] hfiles 2023-07-15 03:12:38,737 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testEmptyExportFileSystemState/5a5a6b11abe9541fb5d68f6563ea5acb/cf/cb18745afc2e41f8b3cfa6c8ef464c23 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,756 INFO [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testEmptyExportFileSystemState/338ff62b94a1e59aa6e6313ac9092d01/cf/e03b0824ae9d4099855fe3d79bc22deb, entries=46, sequenceid=6, filesize=12.9 K 2023-07-15 03:12:38,757 INFO [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 338ff62b94a1e59aa6e6313ac9092d01 in 121ms, sequenceid=6, compaction requested=false 2023-07-15 03:12:38,760 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 338ff62b94a1e59aa6e6313ac9092d01: 2023-07-15 03:12:38,760 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689390756962.338ff62b94a1e59aa6e6313ac9092d01.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,761 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:12:38,761 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testEmptyExportFileSystemState/338ff62b94a1e59aa6e6313ac9092d01/cf/e03b0824ae9d4099855fe3d79bc22deb] hfiles 2023-07-15 03:12:38,761 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testEmptyExportFileSystemState/338ff62b94a1e59aa6e6313ac9092d01/cf/e03b0824ae9d4099855fe3d79bc22deb for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,786 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689390756962.338ff62b94a1e59aa6e6313ac9092d01. completed. 2023-07-15 03:12:38,786 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689390756962.338ff62b94a1e59aa6e6313ac9092d01. 2023-07-15 03:12:38,786 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:12:38,786 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:12:38,786 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:38,786 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 03:12:38,786 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37439,1689390651159' in zk 2023-07-15 03:12:38,788 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 03:12:38,788 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:38,788 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:38,788 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 03:12:38,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:38,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:38,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:38,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:38,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:38,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:38,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:38,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:38,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:38,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:38,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:38,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:38,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37439,1689390651159': 2023-07-15 03:12:38,794 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37439,1689390651159' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-15 03:12:38,852 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:12:38,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 03:12:38,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 03:12:38,854 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 03:12:39,154 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:12:39,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 03:12:39,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 03:12:39,156 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-15 03:12:39,170 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689390756962.5a5a6b11abe9541fb5d68f6563ea5acb. completed. 2023-07-15 03:12:39,170 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689390756962.5a5a6b11abe9541fb5d68f6563ea5acb. 2023-07-15 03:12:39,170 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:12:39,170 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:12:39,170 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:39,170 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 03:12:39,170 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40245,1689390651089' in zk 2023-07-15 03:12:39,172 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 03:12:39,172 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:39,172 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 03:12:39,174 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:39,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:39,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:39,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:39,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:39,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:39,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:39,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:39,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:39,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:39,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:39,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:39,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:39,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:39,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:39,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40245,1689390651089': 2023-07-15 03:12:39,179 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40245,1689390651089' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-15 03:12:39,179 INFO [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-15 03:12:39,179 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 03:12:39,179 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 03:12:39,179 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:39,179 INFO [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 03:12:39,183 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:39,183 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:39,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:39,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:39,183 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:39,183 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:39,183 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:39,183 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:39,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:39,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:39,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:39,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:39,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:39,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:39,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:39,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:39,183 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:39,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:39,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:39,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:39,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:39,184 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:39,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:39,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:39,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:39,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:39,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:39,185 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:39,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:39,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:39,185 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:39,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:39,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:39,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:39,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:39,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:39,187 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:39,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:39,188 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:39,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:39,188 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:39,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:39,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:39,192 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:39,192 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:39,192 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:39,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:39,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:39,192 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:39,192 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:39,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:39,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:39,193 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:39,193 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:39,193 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:39,193 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:39,193 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:39,193 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:39,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:39,193 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:39,193 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:39,193 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-15 03:12:39,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:39,193 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:39,195 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:39,195 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:39,195 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:39,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:39,195 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:39,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:39,195 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 03:12:39,195 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:39,196 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:39,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:39,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:39,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:39,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:39,197 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230715370705d848be490cbcd97e8fef5dd78a, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230715d121f9bea11341d3ad60d4ea0c7ce511] mob files 2023-07-15 03:12:39,197 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230715370705d848be490cbcd97e8fef5dd78a 2023-07-15 03:12:39,197 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230715d121f9bea11341d3ad60d4ea0c7ce511 2023-07-15 03:12:39,215 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:39,216 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:39,260 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:39,306 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-15 03:12:39,307 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:39,307 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:39,307 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689390758549Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689390759215 (+666 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689390759215Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689390759215Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689390759227 (+12 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689390759247 (+20 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689390759306 (+59 ms) 2023-07-15 03:12:39,310 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 03:12:39,312 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 760 msec 2023-07-15 03:12:39,656 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:12:39,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 03:12:39,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 03:12:39,658 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390759658 2023-07-15 03:12:39,658 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33795, tgtDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390759658, rawTgtDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390759658, srcFsUri=hdfs://localhost:33795, srcDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d 2023-07-15 03:12:39,689 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33795, inputRoot=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d 2023-07-15 03:12:39,689 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-442624732_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390759658, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390759658/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:39,690 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33795, inputRoot=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d, snapshotDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-15 03:12:39,697 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390759658/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:39,735 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:39,736 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:39,737 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:39,737 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:40,294 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660272_0005_000001 (auth:SIMPLE) 2023-07-15 03:12:40,946 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/hadoop-8672409951031729599.jar 2023-07-15 03:12:40,946 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:40,947 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:41,033 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/hadoop-3847534707803223975.jar 2023-07-15 03:12:41,034 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:41,034 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:41,035 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:41,036 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:41,036 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:41,037 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:41,037 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 03:12:41,038 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 03:12:41,038 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 03:12:41,039 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 03:12:41,039 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 03:12:41,040 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 03:12:41,041 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 03:12:41,041 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 03:12:41,042 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 03:12:41,043 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 03:12:41,043 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:12:41,044 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:12:41,044 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 03:12:41,044 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:12:41,045 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:12:41,045 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 03:12:41,046 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 03:12:41,922 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 03:12:42,588 WARN [Listener at jenkins-hbase4.apache.org/35095] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 03:12:42,592 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-15 03:12:42,915 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 03:12:42,915 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 03:12:43,313 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660272_0006_000001 (auth:SIMPLE) 2023-07-15 03:12:49,633 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660272_0006_000001 (auth:SIMPLE) 2023-07-15 03:12:52,051 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 03:12:52,052 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 03:12:52,063 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:52,063 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 03:12:52,064 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 03:12:52,064 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_351679589_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:52,065 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(367): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-15 03:12:52,065 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(367): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-15 03:12:52,065 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_351679589_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390759658/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390759658/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:52,066 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(367): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390759658/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-15 03:12:52,066 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(367): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390759658/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-15 03:12:52,073 INFO [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-15 03:12:52,074 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-15 03:12:52,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 03:12:52,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-15 03:12:52,080 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390772080"}]},"ts":"1689390772080"} 2023-07-15 03:12:52,082 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-15 03:12:52,084 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-15 03:12:52,088 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5a5a6b11abe9541fb5d68f6563ea5acb, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=338ff62b94a1e59aa6e6313ac9092d01, UNASSIGN}] 2023-07-15 03:12:52,089 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=338ff62b94a1e59aa6e6313ac9092d01, UNASSIGN 2023-07-15 03:12:52,095 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5a5a6b11abe9541fb5d68f6563ea5acb, UNASSIGN 2023-07-15 03:12:52,095 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=338ff62b94a1e59aa6e6313ac9092d01, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:52,095 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689390756962.338ff62b94a1e59aa6e6313ac9092d01.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689390772095"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390772095"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390772095"}]},"ts":"1689390772095"} 2023-07-15 03:12:52,096 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=5a5a6b11abe9541fb5d68f6563ea5acb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:52,097 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689390756962.5a5a6b11abe9541fb5d68f6563ea5acb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689390772096"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390772096"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390772096"}]},"ts":"1689390772096"} 2023-07-15 03:12:52,100 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure 338ff62b94a1e59aa6e6313ac9092d01, server=jenkins-hbase4.apache.org,37439,1689390651159}] 2023-07-15 03:12:52,101 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 5a5a6b11abe9541fb5d68f6563ea5acb, server=jenkins-hbase4.apache.org,40245,1689390651089}] 2023-07-15 03:12:52,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-15 03:12:52,254 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5a5a6b11abe9541fb5d68f6563ea5acb 2023-07-15 03:12:52,254 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 338ff62b94a1e59aa6e6313ac9092d01 2023-07-15 03:12:52,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5a5a6b11abe9541fb5d68f6563ea5acb, disabling compactions & flushes 2023-07-15 03:12:52,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 338ff62b94a1e59aa6e6313ac9092d01, disabling compactions & flushes 2023-07-15 03:12:52,254 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689390756962.5a5a6b11abe9541fb5d68f6563ea5acb. 2023-07-15 03:12:52,254 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689390756962.338ff62b94a1e59aa6e6313ac9092d01. 2023-07-15 03:12:52,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689390756962.5a5a6b11abe9541fb5d68f6563ea5acb. 2023-07-15 03:12:52,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689390756962.338ff62b94a1e59aa6e6313ac9092d01. 2023-07-15 03:12:52,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689390756962.5a5a6b11abe9541fb5d68f6563ea5acb. after waiting 0 ms 2023-07-15 03:12:52,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689390756962.338ff62b94a1e59aa6e6313ac9092d01. after waiting 0 ms 2023-07-15 03:12:52,255 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689390756962.5a5a6b11abe9541fb5d68f6563ea5acb. 2023-07-15 03:12:52,255 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689390756962.338ff62b94a1e59aa6e6313ac9092d01. 2023-07-15 03:12:52,279 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testEmptyExportFileSystemState/338ff62b94a1e59aa6e6313ac9092d01/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 03:12:52,279 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testEmptyExportFileSystemState/5a5a6b11abe9541fb5d68f6563ea5acb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 03:12:52,279 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:12:52,279 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:12:52,280 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689390756962.338ff62b94a1e59aa6e6313ac9092d01. 2023-07-15 03:12:52,281 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689390756962.5a5a6b11abe9541fb5d68f6563ea5acb. 2023-07-15 03:12:52,282 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 338ff62b94a1e59aa6e6313ac9092d01: 2023-07-15 03:12:52,282 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5a5a6b11abe9541fb5d68f6563ea5acb: 2023-07-15 03:12:52,283 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 338ff62b94a1e59aa6e6313ac9092d01 2023-07-15 03:12:52,285 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=338ff62b94a1e59aa6e6313ac9092d01, regionState=CLOSED 2023-07-15 03:12:52,285 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689390756962.338ff62b94a1e59aa6e6313ac9092d01.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689390772285"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390772285"}]},"ts":"1689390772285"} 2023-07-15 03:12:52,289 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=5a5a6b11abe9541fb5d68f6563ea5acb, regionState=CLOSED 2023-07-15 03:12:52,289 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689390756962.5a5a6b11abe9541fb5d68f6563ea5acb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689390772289"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390772289"}]},"ts":"1689390772289"} 2023-07-15 03:12:52,295 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5a5a6b11abe9541fb5d68f6563ea5acb 2023-07-15 03:12:52,297 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=101 2023-07-15 03:12:52,297 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure 338ff62b94a1e59aa6e6313ac9092d01, server=jenkins-hbase4.apache.org,37439,1689390651159 in 189 msec 2023-07-15 03:12:52,298 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-07-15 03:12:52,298 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=338ff62b94a1e59aa6e6313ac9092d01, UNASSIGN in 209 msec 2023-07-15 03:12:52,298 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 5a5a6b11abe9541fb5d68f6563ea5acb, server=jenkins-hbase4.apache.org,40245,1689390651089 in 196 msec 2023-07-15 03:12:52,300 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-15 03:12:52,300 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5a5a6b11abe9541fb5d68f6563ea5acb, UNASSIGN in 211 msec 2023-07-15 03:12:52,301 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390772301"}]},"ts":"1689390772301"} 2023-07-15 03:12:52,302 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-15 03:12:52,305 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-15 03:12:52,308 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 232 msec 2023-07-15 03:12:52,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-15 03:12:52,382 INFO [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-15 03:12:52,383 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-15 03:12:52,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 03:12:52,387 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 03:12:52,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-15 03:12:52,390 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 03:12:52,391 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43379] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-15 03:12:52,394 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 03:12:52,394 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 03:12:52,394 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 03:12:52,394 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 03:12:52,395 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-15 03:12:52,395 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-15 03:12:52,395 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-15 03:12:52,395 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-15 03:12:52,397 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 03:12:52,397 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:52,397 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 03:12:52,397 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 03:12:52,397 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 03:12:52,397 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:52,397 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:52,398 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:52,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-15 03:12:52,410 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testEmptyExportFileSystemState/338ff62b94a1e59aa6e6313ac9092d01 2023-07-15 03:12:52,411 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testEmptyExportFileSystemState/5a5a6b11abe9541fb5d68f6563ea5acb 2023-07-15 03:12:52,413 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testEmptyExportFileSystemState/338ff62b94a1e59aa6e6313ac9092d01/cf, FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testEmptyExportFileSystemState/338ff62b94a1e59aa6e6313ac9092d01/recovered.edits] 2023-07-15 03:12:52,413 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testEmptyExportFileSystemState/5a5a6b11abe9541fb5d68f6563ea5acb/cf, FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testEmptyExportFileSystemState/5a5a6b11abe9541fb5d68f6563ea5acb/recovered.edits] 2023-07-15 03:12:52,418 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testEmptyExportFileSystemState/338ff62b94a1e59aa6e6313ac9092d01/cf/e03b0824ae9d4099855fe3d79bc22deb to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/archive/data/default/testtb-testEmptyExportFileSystemState/338ff62b94a1e59aa6e6313ac9092d01/cf/e03b0824ae9d4099855fe3d79bc22deb 2023-07-15 03:12:52,419 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testEmptyExportFileSystemState/5a5a6b11abe9541fb5d68f6563ea5acb/cf/cb18745afc2e41f8b3cfa6c8ef464c23 to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/archive/data/default/testtb-testEmptyExportFileSystemState/5a5a6b11abe9541fb5d68f6563ea5acb/cf/cb18745afc2e41f8b3cfa6c8ef464c23 2023-07-15 03:12:52,423 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testEmptyExportFileSystemState/338ff62b94a1e59aa6e6313ac9092d01/recovered.edits/9.seqid to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/archive/data/default/testtb-testEmptyExportFileSystemState/338ff62b94a1e59aa6e6313ac9092d01/recovered.edits/9.seqid 2023-07-15 03:12:52,424 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testEmptyExportFileSystemState/338ff62b94a1e59aa6e6313ac9092d01 2023-07-15 03:12:52,424 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testEmptyExportFileSystemState/5a5a6b11abe9541fb5d68f6563ea5acb/recovered.edits/9.seqid to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/archive/data/default/testtb-testEmptyExportFileSystemState/5a5a6b11abe9541fb5d68f6563ea5acb/recovered.edits/9.seqid 2023-07-15 03:12:52,425 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testEmptyExportFileSystemState/5a5a6b11abe9541fb5d68f6563ea5acb 2023-07-15 03:12:52,425 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-15 03:12:52,426 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-15 03:12:52,427 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-15 03:12:52,431 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230715370705d848be490cbcd97e8fef5dd78a to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230715370705d848be490cbcd97e8fef5dd78a 2023-07-15 03:12:52,432 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230715d121f9bea11341d3ad60d4ea0c7ce511 to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230715d121f9bea11341d3ad60d4ea0c7ce511 2023-07-15 03:12:52,432 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-15 03:12:52,437 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 03:12:52,440 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-15 03:12:52,447 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-15 03:12:52,448 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 03:12:52,449 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-15 03:12:52,449 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689390756962.5a5a6b11abe9541fb5d68f6563ea5acb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689390772449"}]},"ts":"9223372036854775807"} 2023-07-15 03:12:52,449 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689390756962.338ff62b94a1e59aa6e6313ac9092d01.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689390772449"}]},"ts":"9223372036854775807"} 2023-07-15 03:12:52,461 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 03:12:52,461 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5a5a6b11abe9541fb5d68f6563ea5acb, NAME => 'testtb-testEmptyExportFileSystemState,,1689390756962.5a5a6b11abe9541fb5d68f6563ea5acb.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 338ff62b94a1e59aa6e6313ac9092d01, NAME => 'testtb-testEmptyExportFileSystemState,1,1689390756962.338ff62b94a1e59aa6e6313ac9092d01.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 03:12:52,461 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-15 03:12:52,461 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689390772461"}]},"ts":"9223372036854775807"} 2023-07-15 03:12:52,463 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-15 03:12:52,466 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 03:12:52,468 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 83 msec 2023-07-15 03:12:52,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-15 03:12:52,500 INFO [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-15 03:12:52,508 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-15 03:12:52,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:52,513 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-15 03:12:52,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-15 03:12:52,547 INFO [Listener at jenkins-hbase4.apache.org/35095] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=760 (was 758) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1575588394) connection to jenkins-hbase4.apache.org/172.31.14.131:35095 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_351679589_17 at /127.0.0.1:57638 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2eee99d1-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1575588394) connection to jenkins-hbase4.apache.org/172.31.14.131:37007 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1575588394) connection to jenkins-hbase4.apache.org/172.31.14.131:43907 from appattempt_1689390660272_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2eee99d1-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5028 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-432156430_1 at /127.0.0.1:57610 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2eee99d1-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-432156430_1 at /127.0.0.1:55668 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_351679589_17 at /127.0.0.1:58358 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2eee99d1-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=916 (was 904) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=637 (was 600) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 186), AvailableMemoryMB=1250 (was 1689) 2023-07-15 03:12:52,547 WARN [Listener at jenkins-hbase4.apache.org/35095] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-15 03:12:52,571 INFO [Listener at jenkins-hbase4.apache.org/35095] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=760, OpenFileDescriptor=916, MaxFileDescriptor=60000, SystemLoadAverage=637, ProcessCount=183, AvailableMemoryMB=1249 2023-07-15 03:12:52,571 WARN [Listener at jenkins-hbase4.apache.org/35095] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-15 03:12:52,573 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-15 03:12:52,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:52,578 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 03:12:52,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-15 03:12:52,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-15 03:12:52,581 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 03:12:52,583 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/10a3c37ba341821ca0fa881475dfa74c 2023-07-15 03:12:52,583 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0e90269eb6b01b7e2d2e3efdb6e09e89 2023-07-15 03:12:52,584 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/10a3c37ba341821ca0fa881475dfa74c empty. 2023-07-15 03:12:52,584 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0e90269eb6b01b7e2d2e3efdb6e09e89 empty. 2023-07-15 03:12:52,584 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/10a3c37ba341821ca0fa881475dfa74c 2023-07-15 03:12:52,584 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0e90269eb6b01b7e2d2e3efdb6e09e89 2023-07-15 03:12:52,584 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-15 03:12:52,596 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-15 03:12:52,598 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0e90269eb6b01b7e2d2e3efdb6e09e89, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689390772572.0e90269eb6b01b7e2d2e3efdb6e09e89.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp 2023-07-15 03:12:52,598 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 10a3c37ba341821ca0fa881475dfa74c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689390772572.10a3c37ba341821ca0fa881475dfa74c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp 2023-07-15 03:12:52,614 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689390772572.0e90269eb6b01b7e2d2e3efdb6e09e89.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:12:52,614 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 0e90269eb6b01b7e2d2e3efdb6e09e89, disabling compactions & flushes 2023-07-15 03:12:52,614 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689390772572.0e90269eb6b01b7e2d2e3efdb6e09e89. 2023-07-15 03:12:52,614 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689390772572.0e90269eb6b01b7e2d2e3efdb6e09e89. 2023-07-15 03:12:52,614 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689390772572.0e90269eb6b01b7e2d2e3efdb6e09e89. after waiting 0 ms 2023-07-15 03:12:52,614 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689390772572.0e90269eb6b01b7e2d2e3efdb6e09e89. 2023-07-15 03:12:52,614 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689390772572.0e90269eb6b01b7e2d2e3efdb6e09e89. 2023-07-15 03:12:52,614 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 0e90269eb6b01b7e2d2e3efdb6e09e89: 2023-07-15 03:12:52,614 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689390772572.10a3c37ba341821ca0fa881475dfa74c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:12:52,614 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 10a3c37ba341821ca0fa881475dfa74c, disabling compactions & flushes 2023-07-15 03:12:52,614 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689390772572.10a3c37ba341821ca0fa881475dfa74c. 2023-07-15 03:12:52,614 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689390772572.10a3c37ba341821ca0fa881475dfa74c. 2023-07-15 03:12:52,614 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689390772572.10a3c37ba341821ca0fa881475dfa74c. after waiting 0 ms 2023-07-15 03:12:52,614 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689390772572.10a3c37ba341821ca0fa881475dfa74c. 2023-07-15 03:12:52,614 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689390772572.10a3c37ba341821ca0fa881475dfa74c. 2023-07-15 03:12:52,614 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 10a3c37ba341821ca0fa881475dfa74c: 2023-07-15 03:12:52,617 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 03:12:52,618 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689390772572.0e90269eb6b01b7e2d2e3efdb6e09e89.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689390772618"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390772618"}]},"ts":"1689390772618"} 2023-07-15 03:12:52,618 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689390772572.10a3c37ba341821ca0fa881475dfa74c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689390772618"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390772618"}]},"ts":"1689390772618"} 2023-07-15 03:12:52,620 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 03:12:52,620 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 03:12:52,620 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390772620"}]},"ts":"1689390772620"} 2023-07-15 03:12:52,621 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-15 03:12:52,624 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 03:12:52,625 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 03:12:52,625 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 03:12:52,625 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 03:12:52,625 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 03:12:52,625 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=10a3c37ba341821ca0fa881475dfa74c, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0e90269eb6b01b7e2d2e3efdb6e09e89, ASSIGN}] 2023-07-15 03:12:52,628 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=10a3c37ba341821ca0fa881475dfa74c, ASSIGN 2023-07-15 03:12:52,628 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0e90269eb6b01b7e2d2e3efdb6e09e89, ASSIGN 2023-07-15 03:12:52,628 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=10a3c37ba341821ca0fa881475dfa74c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40245,1689390651089; forceNewPlan=false, retain=false 2023-07-15 03:12:52,628 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0e90269eb6b01b7e2d2e3efdb6e09e89, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37439,1689390651159; forceNewPlan=false, retain=false 2023-07-15 03:12:52,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-15 03:12:52,779 INFO [jenkins-hbase4:45731] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 03:12:52,781 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=0e90269eb6b01b7e2d2e3efdb6e09e89, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:52,781 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=10a3c37ba341821ca0fa881475dfa74c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:52,782 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689390772572.0e90269eb6b01b7e2d2e3efdb6e09e89.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689390772781"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390772781"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390772781"}]},"ts":"1689390772781"} 2023-07-15 03:12:52,782 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689390772572.10a3c37ba341821ca0fa881475dfa74c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689390772781"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390772781"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390772781"}]},"ts":"1689390772781"} 2023-07-15 03:12:52,783 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 0e90269eb6b01b7e2d2e3efdb6e09e89, server=jenkins-hbase4.apache.org,37439,1689390651159}] 2023-07-15 03:12:52,784 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 10a3c37ba341821ca0fa881475dfa74c, server=jenkins-hbase4.apache.org,40245,1689390651089}] 2023-07-15 03:12:52,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-15 03:12:52,938 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689390772572.0e90269eb6b01b7e2d2e3efdb6e09e89. 2023-07-15 03:12:52,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0e90269eb6b01b7e2d2e3efdb6e09e89, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689390772572.0e90269eb6b01b7e2d2e3efdb6e09e89.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 03:12:52,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689390772572.0e90269eb6b01b7e2d2e3efdb6e09e89. service=AccessControlService 2023-07-15 03:12:52,939 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 03:12:52,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 0e90269eb6b01b7e2d2e3efdb6e09e89 2023-07-15 03:12:52,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689390772572.0e90269eb6b01b7e2d2e3efdb6e09e89.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:12:52,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0e90269eb6b01b7e2d2e3efdb6e09e89 2023-07-15 03:12:52,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0e90269eb6b01b7e2d2e3efdb6e09e89 2023-07-15 03:12:52,943 INFO [StoreOpener-0e90269eb6b01b7e2d2e3efdb6e09e89-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0e90269eb6b01b7e2d2e3efdb6e09e89 2023-07-15 03:12:52,944 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689390772572.10a3c37ba341821ca0fa881475dfa74c. 2023-07-15 03:12:52,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 10a3c37ba341821ca0fa881475dfa74c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689390772572.10a3c37ba341821ca0fa881475dfa74c.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 03:12:52,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689390772572.10a3c37ba341821ca0fa881475dfa74c. service=AccessControlService 2023-07-15 03:12:52,944 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 03:12:52,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 10a3c37ba341821ca0fa881475dfa74c 2023-07-15 03:12:52,945 DEBUG [StoreOpener-0e90269eb6b01b7e2d2e3efdb6e09e89-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithSkipTmp/0e90269eb6b01b7e2d2e3efdb6e09e89/cf 2023-07-15 03:12:52,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689390772572.10a3c37ba341821ca0fa881475dfa74c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 03:12:52,945 DEBUG [StoreOpener-0e90269eb6b01b7e2d2e3efdb6e09e89-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithSkipTmp/0e90269eb6b01b7e2d2e3efdb6e09e89/cf 2023-07-15 03:12:52,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 10a3c37ba341821ca0fa881475dfa74c 2023-07-15 03:12:52,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 10a3c37ba341821ca0fa881475dfa74c 2023-07-15 03:12:52,945 INFO [StoreOpener-0e90269eb6b01b7e2d2e3efdb6e09e89-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0e90269eb6b01b7e2d2e3efdb6e09e89 columnFamilyName cf 2023-07-15 03:12:52,946 INFO [StoreOpener-10a3c37ba341821ca0fa881475dfa74c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 10a3c37ba341821ca0fa881475dfa74c 2023-07-15 03:12:52,947 INFO [StoreOpener-0e90269eb6b01b7e2d2e3efdb6e09e89-1] regionserver.HStore(310): Store=0e90269eb6b01b7e2d2e3efdb6e09e89/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:12:52,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithSkipTmp/0e90269eb6b01b7e2d2e3efdb6e09e89 2023-07-15 03:12:52,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithSkipTmp/0e90269eb6b01b7e2d2e3efdb6e09e89 2023-07-15 03:12:52,951 DEBUG [StoreOpener-10a3c37ba341821ca0fa881475dfa74c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithSkipTmp/10a3c37ba341821ca0fa881475dfa74c/cf 2023-07-15 03:12:52,951 DEBUG [StoreOpener-10a3c37ba341821ca0fa881475dfa74c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithSkipTmp/10a3c37ba341821ca0fa881475dfa74c/cf 2023-07-15 03:12:52,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0e90269eb6b01b7e2d2e3efdb6e09e89 2023-07-15 03:12:52,951 INFO [StoreOpener-10a3c37ba341821ca0fa881475dfa74c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 10a3c37ba341821ca0fa881475dfa74c columnFamilyName cf 2023-07-15 03:12:52,952 INFO [StoreOpener-10a3c37ba341821ca0fa881475dfa74c-1] regionserver.HStore(310): Store=10a3c37ba341821ca0fa881475dfa74c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 03:12:52,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithSkipTmp/0e90269eb6b01b7e2d2e3efdb6e09e89/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 03:12:52,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithSkipTmp/10a3c37ba341821ca0fa881475dfa74c 2023-07-15 03:12:52,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithSkipTmp/10a3c37ba341821ca0fa881475dfa74c 2023-07-15 03:12:52,954 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0e90269eb6b01b7e2d2e3efdb6e09e89; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71961248, jitterRate=0.07230615615844727}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 03:12:52,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0e90269eb6b01b7e2d2e3efdb6e09e89: 2023-07-15 03:12:52,955 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689390772572.0e90269eb6b01b7e2d2e3efdb6e09e89., pid=108, masterSystemTime=1689390772935 2023-07-15 03:12:52,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689390772572.0e90269eb6b01b7e2d2e3efdb6e09e89. 2023-07-15 03:12:52,957 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689390772572.0e90269eb6b01b7e2d2e3efdb6e09e89. 2023-07-15 03:12:52,957 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=0e90269eb6b01b7e2d2e3efdb6e09e89, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:52,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 10a3c37ba341821ca0fa881475dfa74c 2023-07-15 03:12:52,957 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689390772572.0e90269eb6b01b7e2d2e3efdb6e09e89.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689390772957"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689390772957"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689390772957"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689390772957"}]},"ts":"1689390772957"} 2023-07-15 03:12:52,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithSkipTmp/10a3c37ba341821ca0fa881475dfa74c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 03:12:52,960 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 10a3c37ba341821ca0fa881475dfa74c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73333655, jitterRate=0.09275661408901215}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 03:12:52,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 10a3c37ba341821ca0fa881475dfa74c: 2023-07-15 03:12:52,961 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-15 03:12:52,961 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 0e90269eb6b01b7e2d2e3efdb6e09e89, server=jenkins-hbase4.apache.org,37439,1689390651159 in 176 msec 2023-07-15 03:12:52,961 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689390772572.10a3c37ba341821ca0fa881475dfa74c., pid=109, masterSystemTime=1689390772935 2023-07-15 03:12:52,962 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0e90269eb6b01b7e2d2e3efdb6e09e89, ASSIGN in 336 msec 2023-07-15 03:12:52,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689390772572.10a3c37ba341821ca0fa881475dfa74c. 2023-07-15 03:12:52,963 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689390772572.10a3c37ba341821ca0fa881475dfa74c. 2023-07-15 03:12:52,963 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=10a3c37ba341821ca0fa881475dfa74c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:52,963 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689390772572.10a3c37ba341821ca0fa881475dfa74c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689390772963"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689390772963"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689390772963"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689390772963"}]},"ts":"1689390772963"} 2023-07-15 03:12:52,966 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-15 03:12:52,966 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 10a3c37ba341821ca0fa881475dfa74c, server=jenkins-hbase4.apache.org,40245,1689390651089 in 181 msec 2023-07-15 03:12:52,968 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-15 03:12:52,968 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=10a3c37ba341821ca0fa881475dfa74c, ASSIGN in 341 msec 2023-07-15 03:12:52,969 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 03:12:52,969 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390772969"}]},"ts":"1689390772969"} 2023-07-15 03:12:52,970 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-15 03:12:52,972 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 03:12:52,973 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-15 03:12:52,975 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43379] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-15 03:12:52,977 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:52,977 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:52,977 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:52,977 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:12:52,979 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:52,979 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:52,979 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:52,980 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-15 03:12:52,981 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 407 msec 2023-07-15 03:12:53,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-15 03:12:53,183 INFO [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-15 03:12:53,186 DEBUG [Listener at jenkins-hbase4.apache.org/35095] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,186 DEBUG [Listener at jenkins-hbase4.apache.org/35095] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689390772572.10a3c37ba341821ca0fa881475dfa74c. 2023-07-15 03:12:53,188 INFO [Listener at jenkins-hbase4.apache.org/35095] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 03:12:53,205 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 03:12:53,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689390773206 (current time:1689390773206). 2023-07-15 03:12:53,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 03:12:53,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(139): Connect 0x20a16a13 to 127.0.0.1:58749 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:12:53,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22700eea, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:12:53,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:12:53,221 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38780, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:12:53,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x20a16a13 to 127.0.0.1:58749 2023-07-15 03:12:53,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:12:53,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(139): Connect 0x235dd71a to 127.0.0.1:58749 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:12:53,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@807d090, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:12:53,267 DEBUG [hconnection-0x2aa29824-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:12:53,271 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38792, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:12:53,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:12:53,280 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38346, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:12:53,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x235dd71a to 127.0.0.1:58749 2023-07-15 03:12:53,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:12:53,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-15 03:12:53,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 03:12:53,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 03:12:53,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 03:12:53,287 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 03:12:53,288 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689391373288 2023-07-15 03:12:53,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 03:12:53,288 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,291 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 03:12:53,291 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 03:12:53,295 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 03:12:53,297 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 03:12:53,298 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 13 msec 2023-07-15 03:12:53,300 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 03:12:53,300 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689391373300 2023-07-15 03:12:53,317 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,318 INFO [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-15 03:12:53,318 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:53,320 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-15 03:12:53,320 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-15 03:12:53,323 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,323 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,327 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:53,327 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:53,327 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:53,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:53,327 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:53,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:53,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:53,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:53,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:53,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:53,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,328 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:53,328 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:53,328 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,328 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,328 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:53,328 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 03:12:53,328 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-15 03:12:53,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-15 03:12:53,329 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 03:12:53,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-15 03:12:53,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,329 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 03:12:53,329 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 03:12:53,334 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,335 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 03:12:53,335 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:53,338 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,339 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 03:12:53,339 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:53,341 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 03:12:53,341 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,341 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 03:12:53,341 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 03:12:53,341 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:53,341 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 03:12:53,343 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 03:12:53,343 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43379,1689390651212' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 03:12:53,343 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 03:12:53,343 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 03:12:53,343 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37439,1689390651159' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 03:12:53,341 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40245,1689390651089' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 03:12:53,353 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,353 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,353 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:53,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:53,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:53,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:53,353 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,353 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,353 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:53,353 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:53,354 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:12:53,353 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:12:53,354 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,354 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:12:53,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:53,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:53,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:53,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:53,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:53,358 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40245,1689390651089' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-15 03:12:53,358 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50e23352[Count = 1] remaining members to acquire global barrier 2023-07-15 03:12:53,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:53,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:53,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:53,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:53,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:53,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:53,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:53,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:53,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:53,361 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37439,1689390651159' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-15 03:12:53,361 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50e23352[Count = 0] remaining members to acquire global barrier 2023-07-15 03:12:53,361 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-15 03:12:53,362 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,363 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,363 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,363 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 03:12:53,363 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,363 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 03:12:53,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,363 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 03:12:53,364 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 03:12:53,363 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:53,364 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43379,1689390651212' in zk 2023-07-15 03:12:53,366 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 03:12:53,366 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:53,366 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 03:12:53,371 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:53,371 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 03:12:53,371 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:12:53,371 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:12:53,378 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:12:53,378 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:12:53,378 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689390772572.10a3c37ba341821ca0fa881475dfa74c. 2023-07-15 03:12:53,378 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689390772572.0e90269eb6b01b7e2d2e3efdb6e09e89. 2023-07-15 03:12:53,378 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689390772572.10a3c37ba341821ca0fa881475dfa74c. started... 2023-07-15 03:12:53,378 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689390772572.0e90269eb6b01b7e2d2e3efdb6e09e89. started... 2023-07-15 03:12:53,378 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 10a3c37ba341821ca0fa881475dfa74c: 2023-07-15 03:12:53,380 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689390772572.10a3c37ba341821ca0fa881475dfa74c.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,380 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:12:53,380 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 03:12:53,380 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0e90269eb6b01b7e2d2e3efdb6e09e89: 2023-07-15 03:12:53,381 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689390772572.0e90269eb6b01b7e2d2e3efdb6e09e89.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,381 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:12:53,381 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 03:12:53,391 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:12:53,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 03:12:53,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-15 03:12:53,392 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 03:12:53,435 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689390772572.10a3c37ba341821ca0fa881475dfa74c. completed. 2023-07-15 03:12:53,435 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689390772572.10a3c37ba341821ca0fa881475dfa74c. 2023-07-15 03:12:53,435 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:12:53,435 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:12:53,435 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:53,435 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 03:12:53,435 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40245,1689390651089' in zk 2023-07-15 03:12:53,441 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:53,441 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 03:12:53,441 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:53,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:53,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:53,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:53,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:53,441 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 03:12:53,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:53,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,445 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689390772572.0e90269eb6b01b7e2d2e3efdb6e09e89. completed. 2023-07-15 03:12:53,445 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689390772572.0e90269eb6b01b7e2d2e3efdb6e09e89. 2023-07-15 03:12:53,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:53,445 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:12:53,445 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:12:53,445 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:53,445 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 03:12:53,445 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37439,1689390651159' in zk 2023-07-15 03:12:53,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:53,447 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:53,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:53,447 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 03:12:53,447 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:53,447 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 03:12:53,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:53,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:53,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:53,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:53,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40245,1689390651089': 2023-07-15 03:12:53,451 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40245,1689390651089' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-15 03:12:53,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:53,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:53,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:53,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:53,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:53,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:53,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:53,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:53,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:53,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:53,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:53,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:53,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,37439,1689390651159': 2023-07-15 03:12:53,461 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37439,1689390651159' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-15 03:12:53,461 INFO [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-15 03:12:53,461 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 03:12:53,461 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 03:12:53,461 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,461 INFO [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 03:12:53,463 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,463 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,463 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,463 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:53,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,463 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:53,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,463 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,463 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:53,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:53,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:53,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:53,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:53,464 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:53,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:53,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:53,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:53,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:53,465 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:53,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:53,466 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:53,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:53,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:53,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:53,468 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:53,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:53,469 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:53,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:53,476 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:53,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:53,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:53,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:53,479 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:53,479 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:53,479 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:53,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:53,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:53,479 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:53,479 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:53,479 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:53,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:53,480 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,479 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,480 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,480 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp because node does not exist (not an error) 2023-07-15 03:12:53,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:53,480 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:53,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:53,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:53,479 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:53,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:53,480 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,480 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:53,482 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 03:12:53,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:53,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:53,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:53,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:53,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:53,482 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:53,483 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-15 03:12:53,483 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,483 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:53,483 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,483 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:53,483 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:53,483 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,483 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,496 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,496 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,531 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,587 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-15 03:12:53,587 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,587 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,587 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689390773288Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689390773496 (+208 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689390773496Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689390773496Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689390773500 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689390773521 (+21 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689390773587 (+66 ms) 2023-07-15 03:12:53,591 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 03:12:53,593 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:12:53,594 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 302 msec 2023-07-15 03:12:53,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 03:12:53,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 03:12:53,600 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40245] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689390772572.10a3c37ba341821ca0fa881475dfa74c. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 03:12:53,601 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37439] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689390772572.0e90269eb6b01b7e2d2e3efdb6e09e89. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 03:12:53,604 DEBUG [Listener at jenkins-hbase4.apache.org/35095] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,605 DEBUG [Listener at jenkins-hbase4.apache.org/35095] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689390772572.10a3c37ba341821ca0fa881475dfa74c. 2023-07-15 03:12:53,605 INFO [Listener at jenkins-hbase4.apache.org/35095] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 03:12:53,620 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 03:12:53,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689390773620 (current time:1689390773620). 2023-07-15 03:12:53,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 03:12:53,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(139): Connect 0x6ebe8ccf to 127.0.0.1:58749 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:12:53,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@50e34a84, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:12:53,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:12:53,641 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38802, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:12:53,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6ebe8ccf to 127.0.0.1:58749 2023-07-15 03:12:53,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:12:53,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(139): Connect 0x5ac44e94 to 127.0.0.1:58749 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 03:12:53,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@400669f7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 03:12:53,677 DEBUG [hconnection-0xa7bbc19-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:12:53,684 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38810, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:12:53,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 03:12:53,696 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38348, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 03:12:53,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5ac44e94 to 127.0.0.1:58749 2023-07-15 03:12:53,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:12:53,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-15 03:12:53,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 03:12:53,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 03:12:53,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 03:12:53,703 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 03:12:53,704 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689391373704 2023-07-15 03:12:53,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 03:12:53,705 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,706 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 03:12:53,708 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 03:12:53,709 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 03:12:53,709 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 03:12:53,710 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 8 msec 2023-07-15 03:12:53,711 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 03:12:53,713 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689391373713 2023-07-15 03:12:53,758 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,759 INFO [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-15 03:12:53,759 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:53,761 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-15 03:12:53,761 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-15 03:12:53,763 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,763 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,765 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:53,765 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:53,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:53,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:53,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:53,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:53,765 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:53,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:53,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:53,765 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:53,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,767 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,767 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:53,767 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:53,767 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-15 03:12:53,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,768 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,768 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 03:12:53,768 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,768 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 03:12:53,768 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:53,770 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 03:12:53,770 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 03:12:53,770 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43379,1689390651212' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 03:12:53,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-15 03:12:53,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-15 03:12:53,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,771 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 03:12:53,771 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 03:12:53,770 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:53,771 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 03:12:53,777 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,777 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,777 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:12:53,778 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,779 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 03:12:53,779 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:53,784 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,784 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 03:12:53,784 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 03:12:53,784 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 03:12:53,784 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37439,1689390651159' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 03:12:53,784 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 03:12:53,786 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 03:12:53,786 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 03:12:53,786 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40245,1689390651089' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 03:12:53,788 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:53,788 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:53,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:53,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:53,789 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:53,789 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,789 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:53,789 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:12:53,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:53,789 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,789 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 03:12:53,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:53,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:53,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:53,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:53,791 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40245,1689390651089' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-15 03:12:53,791 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7213c07d[Count = 1] remaining members to acquire global barrier 2023-07-15 03:12:53,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:53,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:53,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:53,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:53,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:53,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:53,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:53,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:53,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:53,795 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37439,1689390651159' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-15 03:12:53,795 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7213c07d[Count = 0] remaining members to acquire global barrier 2023-07-15 03:12:53,795 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-15 03:12:53,795 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,800 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,800 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,800 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,801 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 03:12:53,801 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 03:12:53,801 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:53,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,801 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 03:12:53,801 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 03:12:53,801 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43379,1689390651212' in zk 2023-07-15 03:12:53,801 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:53,801 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 03:12:53,803 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 03:12:53,803 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:53,803 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689390651212' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 03:12:53,806 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:12:53,808 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:12:53,809 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 03:12:53,809 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 03:12:53,809 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689390772572.10a3c37ba341821ca0fa881475dfa74c. 2023-07-15 03:12:53,809 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689390772572.0e90269eb6b01b7e2d2e3efdb6e09e89. 2023-07-15 03:12:53,809 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:12:53,809 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689390772572.10a3c37ba341821ca0fa881475dfa74c. started... 2023-07-15 03:12:53,809 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689390772572.0e90269eb6b01b7e2d2e3efdb6e09e89. started... 2023-07-15 03:12:53,810 INFO [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 10a3c37ba341821ca0fa881475dfa74c 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-15 03:12:53,810 INFO [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0e90269eb6b01b7e2d2e3efdb6e09e89 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-15 03:12:53,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 03:12:53,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-15 03:12:53,811 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 03:12:53,855 INFO [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071525189e348e51495fa87333728655cdec to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023071525189e348e51495fa87333728655cdec 2023-07-15 03:12:53,913 INFO [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithSkipTmp/10a3c37ba341821ca0fa881475dfa74c/.tmp/cf/891d2c244bb74a108cf5d35249185682 2023-07-15 03:12:53,922 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithSkipTmp/10a3c37ba341821ca0fa881475dfa74c/.tmp/cf/891d2c244bb74a108cf5d35249185682 as hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithSkipTmp/10a3c37ba341821ca0fa881475dfa74c/cf/891d2c244bb74a108cf5d35249185682 2023-07-15 03:12:53,923 INFO [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230715632c98954e8e46bd9b25ea1d0f3bf7a2 to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230715632c98954e8e46bd9b25ea1d0f3bf7a2 2023-07-15 03:12:53,930 INFO [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithSkipTmp/10a3c37ba341821ca0fa881475dfa74c/cf/891d2c244bb74a108cf5d35249185682, entries=2, sequenceid=6, filesize=5.2 K 2023-07-15 03:12:53,936 INFO [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 10a3c37ba341821ca0fa881475dfa74c in 125ms, sequenceid=6, compaction requested=false 2023-07-15 03:12:53,936 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-15 03:12:53,936 INFO [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithSkipTmp/0e90269eb6b01b7e2d2e3efdb6e09e89/.tmp/cf/27ce594fe30440e99d49ad9b0ff28258 2023-07-15 03:12:53,936 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 10a3c37ba341821ca0fa881475dfa74c: 2023-07-15 03:12:53,936 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689390772572.10a3c37ba341821ca0fa881475dfa74c.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,937 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:12:53,937 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithSkipTmp/10a3c37ba341821ca0fa881475dfa74c/cf/891d2c244bb74a108cf5d35249185682] hfiles 2023-07-15 03:12:53,937 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithSkipTmp/10a3c37ba341821ca0fa881475dfa74c/cf/891d2c244bb74a108cf5d35249185682 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,943 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithSkipTmp/0e90269eb6b01b7e2d2e3efdb6e09e89/.tmp/cf/27ce594fe30440e99d49ad9b0ff28258 as hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithSkipTmp/0e90269eb6b01b7e2d2e3efdb6e09e89/cf/27ce594fe30440e99d49ad9b0ff28258 2023-07-15 03:12:53,949 INFO [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithSkipTmp/0e90269eb6b01b7e2d2e3efdb6e09e89/cf/27ce594fe30440e99d49ad9b0ff28258, entries=48, sequenceid=6, filesize=13.5 K 2023-07-15 03:12:53,950 INFO [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 0e90269eb6b01b7e2d2e3efdb6e09e89 in 140ms, sequenceid=6, compaction requested=false 2023-07-15 03:12:53,952 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0e90269eb6b01b7e2d2e3efdb6e09e89: 2023-07-15 03:12:53,953 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689390772572.0e90269eb6b01b7e2d2e3efdb6e09e89.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,953 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 03:12:53,953 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithSkipTmp/0e90269eb6b01b7e2d2e3efdb6e09e89/cf/27ce594fe30440e99d49ad9b0ff28258] hfiles 2023-07-15 03:12:53,953 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithSkipTmp/0e90269eb6b01b7e2d2e3efdb6e09e89/cf/27ce594fe30440e99d49ad9b0ff28258 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,953 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689390772572.10a3c37ba341821ca0fa881475dfa74c. completed. 2023-07-15 03:12:53,953 DEBUG [rs(jenkins-hbase4.apache.org,40245,1689390651089)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689390772572.10a3c37ba341821ca0fa881475dfa74c. 2023-07-15 03:12:53,953 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:12:53,953 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:12:53,953 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:53,953 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 03:12:53,953 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40245,1689390651089' in zk 2023-07-15 03:12:53,955 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:53,955 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 03:12:53,955 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:53,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:53,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:53,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:53,955 DEBUG [member: 'jenkins-hbase4.apache.org,40245,1689390651089' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 03:12:53,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:53,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:53,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:53,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:53,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:53,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:53,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:53,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:53,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40245,1689390651089': 2023-07-15 03:12:53,961 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40245,1689390651089' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-15 03:12:53,972 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689390772572.0e90269eb6b01b7e2d2e3efdb6e09e89. completed. 2023-07-15 03:12:53,972 DEBUG [rs(jenkins-hbase4.apache.org,37439,1689390651159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689390772572.0e90269eb6b01b7e2d2e3efdb6e09e89. 2023-07-15 03:12:53,972 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 03:12:53,972 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 03:12:53,972 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:53,972 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 03:12:53,972 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37439,1689390651159' in zk 2023-07-15 03:12:53,974 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:53,974 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 03:12:53,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:53,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:53,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:53,974 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:53,974 DEBUG [member: 'jenkins-hbase4.apache.org,37439,1689390651159' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 03:12:53,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:53,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:53,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:53,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:53,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:53,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:53,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:53,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:53,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:53,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,37439,1689390651159': 2023-07-15 03:12:53,982 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37439,1689390651159' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-15 03:12:53,983 INFO [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-15 03:12:53,983 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 03:12:53,983 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 03:12:53,983 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,983 INFO [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 03:12:53,986 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,986 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,986 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:53,986 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,986 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,986 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:53,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 03:12:53,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 03:12:53,987 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:53,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:53,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:53,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:53,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:53,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 03:12:53,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,988 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:53,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:53,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:53,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 03:12:53,989 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:53,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,989 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:53,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:53,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:53,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:53,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 03:12:53,992 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:53,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,993 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:53,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:53,993 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:53,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:53,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:53,997 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:53,997 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:53,997 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:53,997 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:53,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:53,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:53,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:53,997 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:53,997 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:53,997 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:53,997 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:53,997 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 03:12:53,997 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 03:12:53,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 03:12:53,998 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 03:12:53,998 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:12:53,998 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,998 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:12:53,998 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:12:53,998 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,998 DEBUG [(jenkins-hbase4.apache.org,45731,1689390649632)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 03:12:53,999 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:53,998 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:53,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:53,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:54,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:53,999 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:54,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:54,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 03:12:54,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 03:12:54,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 03:12:54,002 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230715632c98954e8e46bd9b25ea1d0f3bf7a2, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023071525189e348e51495fa87333728655cdec] mob files 2023-07-15 03:12:54,002 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230715632c98954e8e46bd9b25ea1d0f3bf7a2 2023-07-15 03:12:54,002 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023071525189e348e51495fa87333728655cdec 2023-07-15 03:12:54,011 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:12:54,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 03:12:54,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-15 03:12:54,012 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 03:12:54,023 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:54,024 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:54,104 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:54,133 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-15 03:12:54,133 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:54,134 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:54,134 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689390773705Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689390774023 (+318 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689390774023Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689390774023Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689390774038 (+15 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689390774087 (+49 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689390774133 (+46 ms) 2023-07-15 03:12:54,137 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 03:12:54,138 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 431 msec 2023-07-15 03:12:54,312 DEBUG [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 03:12:54,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 03:12:54,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 03:12:54,314 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390774314 2023-07-15 03:12:54,314 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33795, tgtDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390774314, rawTgtDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390774314, srcFsUri=hdfs://localhost:33795, srcDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d 2023-07-15 03:12:54,344 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33795, inputRoot=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d 2023-07-15 03:12:54,344 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1487263188_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390774314, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390774314/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:54,345 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33795, inputRoot=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d, snapshotDir=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-15 03:12:54,367 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390774314/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:12:54,462 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:54,462 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:54,463 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:54,463 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:55,532 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/hadoop-4554813525139642847.jar 2023-07-15 03:12:55,532 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:55,532 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:55,601 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/hadoop-5296578644319804466.jar 2023-07-15 03:12:55,601 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:55,602 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:55,602 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:55,603 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:55,603 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:55,603 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 03:12:55,604 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 03:12:55,604 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 03:12:55,604 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 03:12:55,605 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 03:12:55,605 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 03:12:55,606 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 03:12:55,606 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 03:12:55,606 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 03:12:55,607 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 03:12:55,607 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 03:12:55,608 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:12:55,608 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:12:55,609 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 03:12:55,609 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:12:55,609 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 03:12:55,609 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 03:12:55,610 DEBUG [Listener at jenkins-hbase4.apache.org/35095] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 03:12:56,930 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660272_0006_000001 (auth:SIMPLE) 2023-07-15 03:12:57,779 WARN [Listener at jenkins-hbase4.apache.org/35095] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 03:12:57,791 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-15 03:12:57,812 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-15 03:12:57,987 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 03:12:57,987 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 03:12:58,052 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 03:12:58,889 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660272_0007_000001 (auth:SIMPLE) 2023-07-15 03:13:04,760 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660272_0007_000001 (auth:SIMPLE) 2023-07-15 03:13:07,066 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660272_0007_000001 (auth:SIMPLE) 2023-07-15 03:13:10,758 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660272_0007_000001 (auth:SIMPLE) 2023-07-15 03:13:12,193 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 03:13:12,194 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 03:13:12,205 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:12,205 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 03:13:12,206 INFO [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 03:13:12,206 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_351679589_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:12,207 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(367): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-15 03:13:12,207 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(367): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-15 03:13:12,207 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_351679589_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390774314/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390774314/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:12,207 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(367): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390774314/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-15 03:13:12,207 DEBUG [Listener at jenkins-hbase4.apache.org/35095] snapshot.TestExportSnapshot(367): hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/export-test/export-1689390774314/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-15 03:13:12,214 INFO [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:12,215 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:12,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:12,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-15 03:13:12,220 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390792220"}]},"ts":"1689390792220"} 2023-07-15 03:13:12,226 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-15 03:13:12,228 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-15 03:13:12,230 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=10a3c37ba341821ca0fa881475dfa74c, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0e90269eb6b01b7e2d2e3efdb6e09e89, UNASSIGN}] 2023-07-15 03:13:12,233 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0e90269eb6b01b7e2d2e3efdb6e09e89, UNASSIGN 2023-07-15 03:13:12,234 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=10a3c37ba341821ca0fa881475dfa74c, UNASSIGN 2023-07-15 03:13:12,234 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=0e90269eb6b01b7e2d2e3efdb6e09e89, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:13:12,234 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689390772572.0e90269eb6b01b7e2d2e3efdb6e09e89.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689390792234"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390792234"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390792234"}]},"ts":"1689390792234"} 2023-07-15 03:13:12,235 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=10a3c37ba341821ca0fa881475dfa74c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:13:12,235 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689390772572.10a3c37ba341821ca0fa881475dfa74c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689390792234"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689390792234"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689390792234"}]},"ts":"1689390792234"} 2023-07-15 03:13:12,237 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure 0e90269eb6b01b7e2d2e3efdb6e09e89, server=jenkins-hbase4.apache.org,37439,1689390651159}] 2023-07-15 03:13:12,238 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure 10a3c37ba341821ca0fa881475dfa74c, server=jenkins-hbase4.apache.org,40245,1689390651089}] 2023-07-15 03:13:12,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-15 03:13:12,391 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0e90269eb6b01b7e2d2e3efdb6e09e89 2023-07-15 03:13:12,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0e90269eb6b01b7e2d2e3efdb6e09e89, disabling compactions & flushes 2023-07-15 03:13:12,391 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689390772572.0e90269eb6b01b7e2d2e3efdb6e09e89. 2023-07-15 03:13:12,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689390772572.0e90269eb6b01b7e2d2e3efdb6e09e89. 2023-07-15 03:13:12,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689390772572.0e90269eb6b01b7e2d2e3efdb6e09e89. after waiting 0 ms 2023-07-15 03:13:12,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689390772572.0e90269eb6b01b7e2d2e3efdb6e09e89. 2023-07-15 03:13:12,391 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 10a3c37ba341821ca0fa881475dfa74c 2023-07-15 03:13:12,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 10a3c37ba341821ca0fa881475dfa74c, disabling compactions & flushes 2023-07-15 03:13:12,391 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689390772572.10a3c37ba341821ca0fa881475dfa74c. 2023-07-15 03:13:12,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689390772572.10a3c37ba341821ca0fa881475dfa74c. 2023-07-15 03:13:12,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689390772572.10a3c37ba341821ca0fa881475dfa74c. after waiting 0 ms 2023-07-15 03:13:12,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689390772572.10a3c37ba341821ca0fa881475dfa74c. 2023-07-15 03:13:12,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithSkipTmp/0e90269eb6b01b7e2d2e3efdb6e09e89/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 03:13:12,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/default/testtb-testExportFileSystemStateWithSkipTmp/10a3c37ba341821ca0fa881475dfa74c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 03:13:12,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:13:12,425 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689390772572.0e90269eb6b01b7e2d2e3efdb6e09e89. 2023-07-15 03:13:12,425 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0e90269eb6b01b7e2d2e3efdb6e09e89: 2023-07-15 03:13:12,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:13:12,427 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689390772572.10a3c37ba341821ca0fa881475dfa74c. 2023-07-15 03:13:12,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 10a3c37ba341821ca0fa881475dfa74c: 2023-07-15 03:13:12,430 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0e90269eb6b01b7e2d2e3efdb6e09e89 2023-07-15 03:13:12,431 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=0e90269eb6b01b7e2d2e3efdb6e09e89, regionState=CLOSED 2023-07-15 03:13:12,431 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 10a3c37ba341821ca0fa881475dfa74c 2023-07-15 03:13:12,431 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689390772572.0e90269eb6b01b7e2d2e3efdb6e09e89.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689390792431"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390792431"}]},"ts":"1689390792431"} 2023-07-15 03:13:12,432 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=10a3c37ba341821ca0fa881475dfa74c, regionState=CLOSED 2023-07-15 03:13:12,432 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689390772572.10a3c37ba341821ca0fa881475dfa74c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689390792432"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689390792432"}]},"ts":"1689390792432"} 2023-07-15 03:13:12,438 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-07-15 03:13:12,438 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure 0e90269eb6b01b7e2d2e3efdb6e09e89, server=jenkins-hbase4.apache.org,37439,1689390651159 in 197 msec 2023-07-15 03:13:12,439 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=115 2023-07-15 03:13:12,439 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure 10a3c37ba341821ca0fa881475dfa74c, server=jenkins-hbase4.apache.org,40245,1689390651089 in 199 msec 2023-07-15 03:13:12,439 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0e90269eb6b01b7e2d2e3efdb6e09e89, UNASSIGN in 208 msec 2023-07-15 03:13:12,440 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-15 03:13:12,440 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=10a3c37ba341821ca0fa881475dfa74c, UNASSIGN in 209 msec 2023-07-15 03:13:12,441 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689390792441"}]},"ts":"1689390792441"} 2023-07-15 03:13:12,442 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-15 03:13:12,444 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-15 03:13:12,445 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 229 msec 2023-07-15 03:13:12,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-15 03:13:12,523 INFO [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-15 03:13:12,524 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:12,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:12,528 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:12,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:12,529 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:12,531 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43379] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:12,534 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/10a3c37ba341821ca0fa881475dfa74c 2023-07-15 03:13:12,535 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0e90269eb6b01b7e2d2e3efdb6e09e89 2023-07-15 03:13:12,536 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/10a3c37ba341821ca0fa881475dfa74c/cf, FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/10a3c37ba341821ca0fa881475dfa74c/recovered.edits] 2023-07-15 03:13:12,537 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0e90269eb6b01b7e2d2e3efdb6e09e89/cf, FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0e90269eb6b01b7e2d2e3efdb6e09e89/recovered.edits] 2023-07-15 03:13:12,538 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:12,538 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:12,538 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:12,538 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:12,539 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-15 03:13:12,539 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-15 03:13:12,540 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-15 03:13:12,540 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-15 03:13:12,541 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:12,541 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:12,541 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:13:12,541 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:12,541 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:13:12,542 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:13:12,542 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:12,542 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 03:13:12,542 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/10a3c37ba341821ca0fa881475dfa74c/cf/891d2c244bb74a108cf5d35249185682 to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/10a3c37ba341821ca0fa881475dfa74c/cf/891d2c244bb74a108cf5d35249185682 2023-07-15 03:13:12,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-15 03:13:12,545 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0e90269eb6b01b7e2d2e3efdb6e09e89/cf/27ce594fe30440e99d49ad9b0ff28258 to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/0e90269eb6b01b7e2d2e3efdb6e09e89/cf/27ce594fe30440e99d49ad9b0ff28258 2023-07-15 03:13:12,546 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/10a3c37ba341821ca0fa881475dfa74c/recovered.edits/9.seqid to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/10a3c37ba341821ca0fa881475dfa74c/recovered.edits/9.seqid 2023-07-15 03:13:12,547 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/10a3c37ba341821ca0fa881475dfa74c 2023-07-15 03:13:12,548 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0e90269eb6b01b7e2d2e3efdb6e09e89/recovered.edits/9.seqid to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/0e90269eb6b01b7e2d2e3efdb6e09e89/recovered.edits/9.seqid 2023-07-15 03:13:12,549 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0e90269eb6b01b7e2d2e3efdb6e09e89 2023-07-15 03:13:12,549 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-15 03:13:12,549 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-15 03:13:12,550 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-15 03:13:12,562 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230715632c98954e8e46bd9b25ea1d0f3bf7a2 to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230715632c98954e8e46bd9b25ea1d0f3bf7a2 2023-07-15 03:13:12,563 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023071525189e348e51495fa87333728655cdec to hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023071525189e348e51495fa87333728655cdec 2023-07-15 03:13:12,564 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-15 03:13:12,566 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:12,573 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-15 03:13:12,575 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-15 03:13:12,576 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:12,576 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-15 03:13:12,577 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689390772572.10a3c37ba341821ca0fa881475dfa74c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689390792576"}]},"ts":"9223372036854775807"} 2023-07-15 03:13:12,577 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689390772572.0e90269eb6b01b7e2d2e3efdb6e09e89.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689390792576"}]},"ts":"9223372036854775807"} 2023-07-15 03:13:12,580 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 03:13:12,580 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 10a3c37ba341821ca0fa881475dfa74c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689390772572.10a3c37ba341821ca0fa881475dfa74c.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 0e90269eb6b01b7e2d2e3efdb6e09e89, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689390772572.0e90269eb6b01b7e2d2e3efdb6e09e89.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 03:13:12,580 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-15 03:13:12,580 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689390792580"}]},"ts":"9223372036854775807"} 2023-07-15 03:13:12,591 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-15 03:13:12,595 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:12,596 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 71 msec 2023-07-15 03:13:12,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-15 03:13:12,644 INFO [Listener at jenkins-hbase4.apache.org/35095] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-15 03:13:12,652 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-15 03:13:12,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:12,655 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-15 03:13:12,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45731] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 03:13:12,692 INFO [Listener at jenkins-hbase4.apache.org/35095] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763 (was 760) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_932573958_1 at /127.0.0.1:38906 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2eee99d1-shared-pool-46 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1575588394) connection to jenkins-hbase4.apache.org/172.31.14.131:38859 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2eee99d1-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_351679589_17 at /127.0.0.1:35240 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_932573958_1 at /127.0.0.1:35232 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5672 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_351679589_17 at /127.0.0.1:37532 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2eee99d1-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_351679589_17 at /127.0.0.1:38932 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2eee99d1-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=899 (was 916), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=676 (was 637) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 183), AvailableMemoryMB=2106 (was 1249) - AvailableMemoryMB LEAK? - 2023-07-15 03:13:12,692 WARN [Listener at jenkins-hbase4.apache.org/35095] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-15 03:13:12,692 INFO [Listener at jenkins-hbase4.apache.org/35095] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-15 03:13:12,706 INFO [Listener at jenkins-hbase4.apache.org/35095] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-15 03:13:16,957 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689390660272_0007_000001 (auth:SIMPLE) 2023-07-15 03:13:18,025 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 03:13:26,868 INFO [Listener at jenkins-hbase4.apache.org/35095] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-15 03:13:40,997 ERROR [Thread[Thread-411,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-15 03:13:40,998 INFO [Listener at jenkins-hbase4.apache.org/35095] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-15 03:13:41,110 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-15 03:13:41,125 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-15 03:13:41,126 ERROR [Thread[Thread-421,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-15 03:13:41,172 INFO [Listener at jenkins-hbase4.apache.org/35095] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-15 03:13:41,276 ERROR [Thread[Thread-385,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-15 03:13:41,277 INFO [Listener at jenkins-hbase4.apache.org/35095] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-15 03:13:41,277 INFO [Listener at jenkins-hbase4.apache.org/35095] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-15 03:13:41,277 INFO [Listener at jenkins-hbase4.apache.org/35095] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-15 03:13:41,277 DEBUG [Listener at jenkins-hbase4.apache.org/35095] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ed1aec2 to 127.0.0.1:58749 2023-07-15 03:13:41,277 DEBUG [Listener at jenkins-hbase4.apache.org/35095] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:13:41,277 DEBUG [Listener at jenkins-hbase4.apache.org/35095] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-15 03:13:41,277 DEBUG [Listener at jenkins-hbase4.apache.org/35095] util.JVMClusterUtil(257): Found active master hash=133053515, stopped=false 2023-07-15 03:13:41,277 DEBUG [Listener at jenkins-hbase4.apache.org/35095] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:13:41,278 DEBUG [Listener at jenkins-hbase4.apache.org/35095] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-15 03:13:41,278 INFO [Listener at jenkins-hbase4.apache.org/35095] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,45731,1689390649632 2023-07-15 03:13:41,279 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-15 03:13:41,279 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-15 03:13:41,279 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-15 03:13:41,279 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 03:13:41,280 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 03:13:41,280 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 03:13:41,280 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 03:13:41,280 INFO [Listener at jenkins-hbase4.apache.org/35095] procedure2.ProcedureExecutor(629): Stopping 2023-07-15 03:13:41,280 DEBUG [Listener at jenkins-hbase4.apache.org/35095] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x46c1acb5 to 127.0.0.1:58749 2023-07-15 03:13:41,280 DEBUG [Listener at jenkins-hbase4.apache.org/35095] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:13:41,280 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-15 03:13:41,280 INFO [Listener at jenkins-hbase4.apache.org/35095] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40245,1689390651089' ***** 2023-07-15 03:13:41,281 DEBUG [Listener at jenkins-hbase4.apache.org/35095] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:13:41,281 INFO [Listener at jenkins-hbase4.apache.org/35095] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-15 03:13:41,281 INFO [Listener at jenkins-hbase4.apache.org/35095] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,37439,1689390651159' ***** 2023-07-15 03:13:41,281 DEBUG [Listener at jenkins-hbase4.apache.org/35095] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:13:41,281 INFO [Listener at jenkins-hbase4.apache.org/35095] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-15 03:13:41,281 INFO [Listener at jenkins-hbase4.apache.org/35095] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43379,1689390651212' ***** 2023-07-15 03:13:41,281 INFO [RS:0;jenkins-hbase4:40245] regionserver.HeapMemoryManager(220): Stopping 2023-07-15 03:13:41,281 INFO [RS:1;jenkins-hbase4:37439] regionserver.HeapMemoryManager(220): Stopping 2023-07-15 03:13:41,281 INFO [RS:0;jenkins-hbase4:40245] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-15 03:13:41,281 INFO [RS:1;jenkins-hbase4:37439] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-15 03:13:41,282 INFO [RS:0;jenkins-hbase4:40245] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-15 03:13:41,282 INFO [RS:0;jenkins-hbase4:40245] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:13:41,281 DEBUG [Listener at jenkins-hbase4.apache.org/35095] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:13:41,282 DEBUG [RS:0;jenkins-hbase4:40245] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2e41f9c8 to 127.0.0.1:58749 2023-07-15 03:13:41,282 INFO [RS:1;jenkins-hbase4:37439] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-15 03:13:41,282 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-15 03:13:41,282 INFO [RS:1;jenkins-hbase4:37439] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:13:41,282 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-15 03:13:41,282 DEBUG [RS:1;jenkins-hbase4:37439] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2e7a8c53 to 127.0.0.1:58749 2023-07-15 03:13:41,282 DEBUG [RS:1;jenkins-hbase4:37439] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:13:41,281 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 03:13:41,282 DEBUG [RS:0;jenkins-hbase4:40245] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:13:41,282 INFO [Listener at jenkins-hbase4.apache.org/35095] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-15 03:13:41,285 INFO [RS:1;jenkins-hbase4:37439] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-15 03:13:41,286 INFO [RS:1;jenkins-hbase4:37439] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-15 03:13:41,286 INFO [RS:0;jenkins-hbase4:40245] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40245,1689390651089; all regions closed. 2023-07-15 03:13:41,286 INFO [RS:1;jenkins-hbase4:37439] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-15 03:13:41,286 INFO [RS:1;jenkins-hbase4:37439] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-15 03:13:41,290 INFO [RS:1;jenkins-hbase4:37439] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-15 03:13:41,290 INFO [RS:2;jenkins-hbase4:43379] regionserver.HeapMemoryManager(220): Stopping 2023-07-15 03:13:41,291 INFO [RS:2;jenkins-hbase4:43379] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-15 03:13:41,291 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-15 03:13:41,291 DEBUG [RS:1;jenkins-hbase4:37439] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-15 03:13:41,291 INFO [RS:2;jenkins-hbase4:43379] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-15 03:13:41,291 INFO [RS:2;jenkins-hbase4:43379] regionserver.HRegionServer(3305): Received CLOSE for c47f678a8bf1f978de39a7e77ccea25d 2023-07-15 03:13:41,292 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-15 03:13:41,292 INFO [RS:2;jenkins-hbase4:43379] regionserver.HRegionServer(3305): Received CLOSE for cd161ef32dc10f97040884020093175f 2023-07-15 03:13:41,292 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-15 03:13:41,292 INFO [RS:2;jenkins-hbase4:43379] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:13:41,292 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-15 03:13:41,295 DEBUG [RS:1;jenkins-hbase4:37439] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-15 03:13:41,295 DEBUG [RS:2;jenkins-hbase4:43379] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a62bf71 to 127.0.0.1:58749 2023-07-15 03:13:41,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c47f678a8bf1f978de39a7e77ccea25d, disabling compactions & flushes 2023-07-15 03:13:41,295 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689390654090.c47f678a8bf1f978de39a7e77ccea25d. 2023-07-15 03:13:41,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689390654090.c47f678a8bf1f978de39a7e77ccea25d. 2023-07-15 03:13:41,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689390654090.c47f678a8bf1f978de39a7e77ccea25d. after waiting 0 ms 2023-07-15 03:13:41,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689390654090.c47f678a8bf1f978de39a7e77ccea25d. 2023-07-15 03:13:41,295 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing c47f678a8bf1f978de39a7e77ccea25d 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-15 03:13:41,295 DEBUG [RS:2;jenkins-hbase4:43379] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:13:41,295 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-15 03:13:41,296 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-15 03:13:41,296 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-15 03:13:41,297 INFO [RS:2;jenkins-hbase4:43379] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-15 03:13:41,297 DEBUG [RS:2;jenkins-hbase4:43379] regionserver.HRegionServer(1478): Online Regions={c47f678a8bf1f978de39a7e77ccea25d=hbase:namespace,,1689390654090.c47f678a8bf1f978de39a7e77ccea25d., cd161ef32dc10f97040884020093175f=hbase:acl,,1689390654931.cd161ef32dc10f97040884020093175f.} 2023-07-15 03:13:41,298 DEBUG [RS:2;jenkins-hbase4:43379] regionserver.HRegionServer(1504): Waiting on c47f678a8bf1f978de39a7e77ccea25d, cd161ef32dc10f97040884020093175f 2023-07-15 03:13:41,327 DEBUG [RS:0;jenkins-hbase4:40245] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/oldWALs 2023-07-15 03:13:41,328 INFO [RS:0;jenkins-hbase4:40245] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40245%2C1689390651089:(num 1689390653481) 2023-07-15 03:13:41,328 DEBUG [RS:0;jenkins-hbase4:40245] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:13:41,328 INFO [RS:0;jenkins-hbase4:40245] regionserver.LeaseManager(133): Closed leases 2023-07-15 03:13:41,331 INFO [RS:0;jenkins-hbase4:40245] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-15 03:13:41,342 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-15 03:13:41,347 INFO [RS:0;jenkins-hbase4:40245] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-15 03:13:41,347 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-15 03:13:41,347 INFO [RS:0;jenkins-hbase4:40245] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-15 03:13:41,348 INFO [RS:0;jenkins-hbase4:40245] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-15 03:13:41,351 INFO [RS:0;jenkins-hbase4:40245] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40245 2023-07-15 03:13:41,359 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/namespace/c47f678a8bf1f978de39a7e77ccea25d/.tmp/info/1c0fae54aa0a44baa15263ef1b4248a9 2023-07-15 03:13:41,361 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-15 03:13:41,361 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-15 03:13:41,362 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:13:41,362 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 03:13:41,362 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 03:13:41,363 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:13:41,363 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40245,1689390651089 2023-07-15 03:13:41,363 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 03:13:41,363 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 03:13:41,363 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40245,1689390651089] 2023-07-15 03:13:41,365 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40245,1689390651089; numProcessing=1 2023-07-15 03:13:41,367 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/meta/1588230740/.tmp/info/5ccb31ef99b54f9ebde40714de5b7b75 2023-07-15 03:13:41,367 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40245,1689390651089 already deleted, retry=false 2023-07-15 03:13:41,367 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40245,1689390651089 expired; onlineServers=2 2023-07-15 03:13:41,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/namespace/c47f678a8bf1f978de39a7e77ccea25d/.tmp/info/1c0fae54aa0a44baa15263ef1b4248a9 as hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/namespace/c47f678a8bf1f978de39a7e77ccea25d/info/1c0fae54aa0a44baa15263ef1b4248a9 2023-07-15 03:13:41,377 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5ccb31ef99b54f9ebde40714de5b7b75 2023-07-15 03:13:41,385 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/namespace/c47f678a8bf1f978de39a7e77ccea25d/info/1c0fae54aa0a44baa15263ef1b4248a9, entries=2, sequenceid=6, filesize=4.8 K 2023-07-15 03:13:41,386 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for c47f678a8bf1f978de39a7e77ccea25d in 91ms, sequenceid=6, compaction requested=false 2023-07-15 03:13:41,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/namespace/c47f678a8bf1f978de39a7e77ccea25d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 03:13:41,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:13:41,413 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689390654090.c47f678a8bf1f978de39a7e77ccea25d. 2023-07-15 03:13:41,413 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c47f678a8bf1f978de39a7e77ccea25d: 2023-07-15 03:13:41,414 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689390654090.c47f678a8bf1f978de39a7e77ccea25d. 2023-07-15 03:13:41,414 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cd161ef32dc10f97040884020093175f, disabling compactions & flushes 2023-07-15 03:13:41,414 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689390654931.cd161ef32dc10f97040884020093175f. 2023-07-15 03:13:41,414 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689390654931.cd161ef32dc10f97040884020093175f. 2023-07-15 03:13:41,414 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689390654931.cd161ef32dc10f97040884020093175f. after waiting 0 ms 2023-07-15 03:13:41,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689390654931.cd161ef32dc10f97040884020093175f. 2023-07-15 03:13:41,415 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing cd161ef32dc10f97040884020093175f 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-15 03:13:41,418 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/meta/1588230740/.tmp/rep_barrier/eb509967241041649dbf24d23189d1e6 2023-07-15 03:13:41,422 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eb509967241041649dbf24d23189d1e6 2023-07-15 03:13:41,431 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/acl/cd161ef32dc10f97040884020093175f/.tmp/l/dc8ed70c67e841e391f135f599249bb6 2023-07-15 03:13:41,435 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dc8ed70c67e841e391f135f599249bb6 2023-07-15 03:13:41,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/acl/cd161ef32dc10f97040884020093175f/.tmp/l/dc8ed70c67e841e391f135f599249bb6 as hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/acl/cd161ef32dc10f97040884020093175f/l/dc8ed70c67e841e391f135f599249bb6 2023-07-15 03:13:41,437 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/meta/1588230740/.tmp/table/cabdf4ccecef45b48b206d53a7fee735 2023-07-15 03:13:41,441 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cabdf4ccecef45b48b206d53a7fee735 2023-07-15 03:13:41,441 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dc8ed70c67e841e391f135f599249bb6 2023-07-15 03:13:41,441 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/acl/cd161ef32dc10f97040884020093175f/l/dc8ed70c67e841e391f135f599249bb6, entries=7, sequenceid=18, filesize=5.2 K 2023-07-15 03:13:41,442 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/meta/1588230740/.tmp/info/5ccb31ef99b54f9ebde40714de5b7b75 as hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/meta/1588230740/info/5ccb31ef99b54f9ebde40714de5b7b75 2023-07-15 03:13:41,442 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for cd161ef32dc10f97040884020093175f in 27ms, sequenceid=18, compaction requested=false 2023-07-15 03:13:41,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/acl/cd161ef32dc10f97040884020093175f/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-15 03:13:41,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:13:41,449 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689390654931.cd161ef32dc10f97040884020093175f. 2023-07-15 03:13:41,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cd161ef32dc10f97040884020093175f: 2023-07-15 03:13:41,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689390654931.cd161ef32dc10f97040884020093175f. 2023-07-15 03:13:41,450 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5ccb31ef99b54f9ebde40714de5b7b75 2023-07-15 03:13:41,450 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/meta/1588230740/info/5ccb31ef99b54f9ebde40714de5b7b75, entries=48, sequenceid=131, filesize=10.3 K 2023-07-15 03:13:41,451 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/meta/1588230740/.tmp/rep_barrier/eb509967241041649dbf24d23189d1e6 as hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/meta/1588230740/rep_barrier/eb509967241041649dbf24d23189d1e6 2023-07-15 03:13:41,455 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eb509967241041649dbf24d23189d1e6 2023-07-15 03:13:41,455 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/meta/1588230740/rep_barrier/eb509967241041649dbf24d23189d1e6, entries=13, sequenceid=131, filesize=6.4 K 2023-07-15 03:13:41,456 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/meta/1588230740/.tmp/table/cabdf4ccecef45b48b206d53a7fee735 as hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/meta/1588230740/table/cabdf4ccecef45b48b206d53a7fee735 2023-07-15 03:13:41,465 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cabdf4ccecef45b48b206d53a7fee735 2023-07-15 03:13:41,465 INFO [RS:0;jenkins-hbase4:40245] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40245,1689390651089; zookeeper connection closed. 2023-07-15 03:13:41,465 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/meta/1588230740/table/cabdf4ccecef45b48b206d53a7fee735, entries=24, sequenceid=131, filesize=6.9 K 2023-07-15 03:13:41,465 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 03:13:41,465 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:40245-0x10166f610420001, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 03:13:41,466 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@65f20c15] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@65f20c15 2023-07-15 03:13:41,466 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 170ms, sequenceid=131, compaction requested=false 2023-07-15 03:13:41,486 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-15 03:13:41,487 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 03:13:41,487 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-15 03:13:41,488 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-15 03:13:41,488 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-15 03:13:41,488 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-15 03:13:41,495 INFO [RS:1;jenkins-hbase4:37439] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,37439,1689390651159; all regions closed. 2023-07-15 03:13:41,498 INFO [RS:2;jenkins-hbase4:43379] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43379,1689390651212; all regions closed. 2023-07-15 03:13:41,499 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/WALs/jenkins-hbase4.apache.org,37439,1689390651159/jenkins-hbase4.apache.org%2C37439%2C1689390651159.meta.1689390653679.meta not finished, retry = 0 2023-07-15 03:13:41,509 DEBUG [RS:2;jenkins-hbase4:43379] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/oldWALs 2023-07-15 03:13:41,509 INFO [RS:2;jenkins-hbase4:43379] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43379%2C1689390651212:(num 1689390653481) 2023-07-15 03:13:41,509 DEBUG [RS:2;jenkins-hbase4:43379] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:13:41,509 INFO [RS:2;jenkins-hbase4:43379] regionserver.LeaseManager(133): Closed leases 2023-07-15 03:13:41,509 INFO [RS:2;jenkins-hbase4:43379] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-15 03:13:41,510 INFO [RS:2;jenkins-hbase4:43379] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-15 03:13:41,510 INFO [RS:2;jenkins-hbase4:43379] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-15 03:13:41,510 INFO [RS:2;jenkins-hbase4:43379] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-15 03:13:41,510 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-15 03:13:41,511 INFO [RS:2;jenkins-hbase4:43379] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43379 2023-07-15 03:13:41,513 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:13:41,513 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43379,1689390651212 2023-07-15 03:13:41,513 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 03:13:41,514 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43379,1689390651212] 2023-07-15 03:13:41,514 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43379,1689390651212; numProcessing=2 2023-07-15 03:13:41,515 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43379,1689390651212 already deleted, retry=false 2023-07-15 03:13:41,515 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43379,1689390651212 expired; onlineServers=1 2023-07-15 03:13:41,601 DEBUG [RS:1;jenkins-hbase4:37439] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/oldWALs 2023-07-15 03:13:41,602 INFO [RS:1;jenkins-hbase4:37439] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37439%2C1689390651159.meta:.meta(num 1689390653679) 2023-07-15 03:13:41,606 DEBUG [RS:1;jenkins-hbase4:37439] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/oldWALs 2023-07-15 03:13:41,606 INFO [RS:1;jenkins-hbase4:37439] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37439%2C1689390651159:(num 1689390653481) 2023-07-15 03:13:41,606 DEBUG [RS:1;jenkins-hbase4:37439] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:13:41,607 INFO [RS:1;jenkins-hbase4:37439] regionserver.LeaseManager(133): Closed leases 2023-07-15 03:13:41,607 INFO [RS:1;jenkins-hbase4:37439] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-15 03:13:41,607 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-15 03:13:41,608 INFO [RS:1;jenkins-hbase4:37439] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37439 2023-07-15 03:13:41,610 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 03:13:41,610 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37439,1689390651159 2023-07-15 03:13:41,610 ERROR [Listener at localhost/40311-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@43996e26 rejected from java.util.concurrent.ThreadPoolExecutor@47a6e28d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 113] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:603) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-07-15 03:13:41,610 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37439,1689390651159] 2023-07-15 03:13:41,611 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37439,1689390651159; numProcessing=3 2023-07-15 03:13:41,612 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37439,1689390651159 already deleted, retry=false 2023-07-15 03:13:41,612 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37439,1689390651159 expired; onlineServers=0 2023-07-15 03:13:41,612 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45731,1689390649632' ***** 2023-07-15 03:13:41,612 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-15 03:13:41,612 DEBUG [M:0;jenkins-hbase4:45731] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46d33670, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-15 03:13:41,612 INFO [M:0;jenkins-hbase4:45731] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45731,1689390649632 2023-07-15 03:13:41,612 INFO [M:0;jenkins-hbase4:45731] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45731,1689390649632; all regions closed. 2023-07-15 03:13:41,612 DEBUG [M:0;jenkins-hbase4:45731] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 03:13:41,613 DEBUG [M:0;jenkins-hbase4:45731] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-15 03:13:41,613 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-15 03:13:41,613 DEBUG [M:0;jenkins-hbase4:45731] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-15 03:13:41,613 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689390652964] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689390652964,5,FailOnTimeoutGroup] 2023-07-15 03:13:41,613 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689390652967] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689390652967,5,FailOnTimeoutGroup] 2023-07-15 03:13:41,613 INFO [M:0;jenkins-hbase4:45731] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-15 03:13:41,613 INFO [M:0;jenkins-hbase4:45731] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-15 03:13:41,613 INFO [M:0;jenkins-hbase4:45731] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-15 03:13:41,613 DEBUG [M:0;jenkins-hbase4:45731] master.HMaster(1512): Stopping service threads 2023-07-15 03:13:41,613 INFO [M:0;jenkins-hbase4:45731] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-15 03:13:41,613 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-15 03:13:41,614 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 03:13:41,614 ERROR [M:0;jenkins-hbase4:45731] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-15 03:13:41,614 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 03:13:41,614 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 03:13:41,614 INFO [RS:2;jenkins-hbase4:43379] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43379,1689390651212; zookeeper connection closed. 2023-07-15 03:13:41,614 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x10166f610420003, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 03:13:41,615 INFO [M:0;jenkins-hbase4:45731] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-15 03:13:41,615 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@41840de8] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@41840de8 2023-07-15 03:13:41,615 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-15 03:13:41,615 DEBUG [M:0;jenkins-hbase4:45731] zookeeper.ZKUtil(398): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-15 03:13:41,615 WARN [M:0;jenkins-hbase4:45731] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-15 03:13:41,615 INFO [M:0;jenkins-hbase4:45731] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-15 03:13:41,616 INFO [M:0;jenkins-hbase4:45731] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-15 03:13:41,616 DEBUG [M:0;jenkins-hbase4:45731] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-15 03:13:41,616 INFO [M:0;jenkins-hbase4:45731] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 03:13:41,616 DEBUG [M:0;jenkins-hbase4:45731] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 03:13:41,616 DEBUG [M:0;jenkins-hbase4:45731] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-15 03:13:41,616 DEBUG [M:0;jenkins-hbase4:45731] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 03:13:41,617 INFO [M:0;jenkins-hbase4:45731] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.68 KB heapSize=452 KB 2023-07-15 03:13:41,636 INFO [M:0;jenkins-hbase4:45731] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.68 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/89bc00ec33964303888a300a2b6a7523 2023-07-15 03:13:41,640 INFO [M:0;jenkins-hbase4:45731] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 89bc00ec33964303888a300a2b6a7523 2023-07-15 03:13:41,640 DEBUG [M:0;jenkins-hbase4:45731] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/89bc00ec33964303888a300a2b6a7523 as hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/89bc00ec33964303888a300a2b6a7523 2023-07-15 03:13:41,644 INFO [M:0;jenkins-hbase4:45731] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 89bc00ec33964303888a300a2b6a7523 2023-07-15 03:13:41,644 INFO [M:0;jenkins-hbase4:45731] regionserver.HStore(1080): Added hdfs://localhost:33795/user/jenkins/test-data/bbdbdc2d-dc00-b616-946b-26f3674b772d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/89bc00ec33964303888a300a2b6a7523, entries=119, sequenceid=899, filesize=28.6 K 2023-07-15 03:13:41,645 INFO [M:0;jenkins-hbase4:45731] regionserver.HRegion(2948): Finished flush of dataSize ~375.68 KB/384697, heapSize ~451.98 KB/462832, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 29ms, sequenceid=899, compaction requested=false 2023-07-15 03:13:41,646 INFO [M:0;jenkins-hbase4:45731] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 03:13:41,646 DEBUG [M:0;jenkins-hbase4:45731] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-15 03:13:41,649 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-15 03:13:41,649 INFO [M:0;jenkins-hbase4:45731] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-15 03:13:41,650 INFO [M:0;jenkins-hbase4:45731] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45731 2023-07-15 03:13:41,652 DEBUG [M:0;jenkins-hbase4:45731] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,45731,1689390649632 already deleted, retry=false 2023-07-15 03:13:41,715 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 03:13:41,715 INFO [RS:1;jenkins-hbase4:37439] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,37439,1689390651159; zookeeper connection closed. 2023-07-15 03:13:41,715 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): regionserver:37439-0x10166f610420002, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 03:13:41,716 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@58b44ee1] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@58b44ee1 2023-07-15 03:13:41,716 INFO [Listener at jenkins-hbase4.apache.org/35095] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-15 03:13:41,815 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 03:13:41,815 INFO [M:0;jenkins-hbase4:45731] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45731,1689390649632; zookeeper connection closed. 2023-07-15 03:13:41,815 DEBUG [Listener at localhost/40311-EventThread] zookeeper.ZKWatcher(600): master:45731-0x10166f610420000, quorum=127.0.0.1:58749, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 03:13:41,817 WARN [Listener at jenkins-hbase4.apache.org/35095] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-15 03:13:41,821 INFO [Listener at jenkins-hbase4.apache.org/35095] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-15 03:13:41,925 WARN [BP-701609184-172.31.14.131-1689390645259 heartbeating to localhost/127.0.0.1:33795] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-15 03:13:41,925 WARN [BP-701609184-172.31.14.131-1689390645259 heartbeating to localhost/127.0.0.1:33795] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-701609184-172.31.14.131-1689390645259 (Datanode Uuid ef2a0e98-1584-41b2-9036-9be628929432) service to localhost/127.0.0.1:33795 2023-07-15 03:13:41,927 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/cluster_28d9752d-d2d9-87a3-fd7d-03f24d387c2d/dfs/data/data5/current/BP-701609184-172.31.14.131-1689390645259] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 03:13:41,927 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/cluster_28d9752d-d2d9-87a3-fd7d-03f24d387c2d/dfs/data/data6/current/BP-701609184-172.31.14.131-1689390645259] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 03:13:41,929 WARN [Listener at jenkins-hbase4.apache.org/35095] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-15 03:13:41,932 INFO [Listener at jenkins-hbase4.apache.org/35095] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-15 03:13:42,036 WARN [BP-701609184-172.31.14.131-1689390645259 heartbeating to localhost/127.0.0.1:33795] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-15 03:13:42,036 WARN [BP-701609184-172.31.14.131-1689390645259 heartbeating to localhost/127.0.0.1:33795] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-701609184-172.31.14.131-1689390645259 (Datanode Uuid df1a242c-a08e-439e-9692-8c68db4e7ebf) service to localhost/127.0.0.1:33795 2023-07-15 03:13:42,037 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/cluster_28d9752d-d2d9-87a3-fd7d-03f24d387c2d/dfs/data/data3/current/BP-701609184-172.31.14.131-1689390645259] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 03:13:42,037 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/cluster_28d9752d-d2d9-87a3-fd7d-03f24d387c2d/dfs/data/data4/current/BP-701609184-172.31.14.131-1689390645259] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 03:13:42,038 WARN [Listener at jenkins-hbase4.apache.org/35095] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-15 03:13:42,044 INFO [Listener at jenkins-hbase4.apache.org/35095] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-15 03:13:42,148 WARN [BP-701609184-172.31.14.131-1689390645259 heartbeating to localhost/127.0.0.1:33795] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-15 03:13:42,148 WARN [BP-701609184-172.31.14.131-1689390645259 heartbeating to localhost/127.0.0.1:33795] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-701609184-172.31.14.131-1689390645259 (Datanode Uuid 46c41bb2-1f9c-4dae-b66e-4f8a5bcb14b1) service to localhost/127.0.0.1:33795 2023-07-15 03:13:42,149 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/cluster_28d9752d-d2d9-87a3-fd7d-03f24d387c2d/dfs/data/data1/current/BP-701609184-172.31.14.131-1689390645259] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 03:13:42,149 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5d67b4ce-53c3-faf3-8f45-c7df0d83b2ad/cluster_28d9752d-d2d9-87a3-fd7d-03f24d387c2d/dfs/data/data2/current/BP-701609184-172.31.14.131-1689390645259] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 03:13:42,177 INFO [Listener at jenkins-hbase4.apache.org/35095] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-15 03:13:42,317 INFO [Listener at jenkins-hbase4.apache.org/35095] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-15 03:13:42,421 INFO [Listener at jenkins-hbase4.apache.org/35095] hbase.HBaseTestingUtility(1293): Minicluster is down