2023-07-22 07:06:06,914 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-22 07:06:07,163 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19 2023-07-22 07:06:07,164 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-22 07:06:07,164 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-22 07:06:07,207 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-22 07:06:07,465 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-22 07:06:07,466 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/cluster_09dad59a-c8af-d239-c3a5-237708feddb2, deleteOnExit=true 2023-07-22 07:06:07,466 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-22 07:06:07,467 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/test.cache.data in system properties and HBase conf 2023-07-22 07:06:07,467 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/hadoop.tmp.dir in system properties and HBase conf 2023-07-22 07:06:07,468 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/hadoop.log.dir in system properties and HBase conf 2023-07-22 07:06:07,468 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-22 07:06:07,469 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-22 07:06:07,469 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-22 07:06:07,800 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-22 07:06:07,807 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-22 07:06:07,807 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-22 07:06:07,808 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-22 07:06:07,808 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-22 07:06:07,809 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-22 07:06:07,809 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-22 07:06:07,812 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-22 07:06:07,814 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-22 07:06:07,814 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-22 07:06:07,814 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/nfs.dump.dir in system properties and HBase conf 2023-07-22 07:06:07,814 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/java.io.tmpdir in system properties and HBase conf 2023-07-22 07:06:07,815 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-22 07:06:07,815 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-22 07:06:07,816 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-22 07:06:08,418 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-22 07:06:08,424 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-22 07:06:08,719 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-22 07:06:08,872 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-22 07:06:08,887 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 07:06:08,934 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 07:06:08,968 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/java.io.tmpdir/Jetty_localhost_45863_hdfs____.7kizcy/webapp 2023-07-22 07:06:09,125 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45863 2023-07-22 07:06:09,180 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-22 07:06:09,181 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-22 07:06:09,752 WARN [Listener at localhost/45491] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-22 07:06:09,920 WARN [Listener at localhost/45491] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-22 07:06:09,947 WARN [Listener at localhost/45491] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 07:06:09,955 INFO [Listener at localhost/45491] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 07:06:09,963 INFO [Listener at localhost/45491] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/java.io.tmpdir/Jetty_localhost_34839_datanode____gnnt38/webapp 2023-07-22 07:06:10,156 INFO [Listener at localhost/45491] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34839 2023-07-22 07:06:10,602 WARN [Listener at localhost/42909] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-22 07:06:10,629 WARN [Listener at localhost/42909] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-22 07:06:10,634 WARN [Listener at localhost/42909] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 07:06:10,637 INFO [Listener at localhost/42909] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 07:06:10,644 INFO [Listener at localhost/42909] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/java.io.tmpdir/Jetty_localhost_38819_datanode____.e6im6/webapp 2023-07-22 07:06:10,766 INFO [Listener at localhost/42909] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38819 2023-07-22 07:06:10,788 WARN [Listener at localhost/34487] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-22 07:06:10,870 WARN [Listener at localhost/34487] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-22 07:06:10,875 WARN [Listener at localhost/34487] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 07:06:10,877 INFO [Listener at localhost/34487] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 07:06:10,885 INFO [Listener at localhost/34487] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/java.io.tmpdir/Jetty_localhost_40491_datanode____wrlp2v/webapp 2023-07-22 07:06:11,025 INFO [Listener at localhost/34487] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40491 2023-07-22 07:06:11,049 WARN [Listener at localhost/45423] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-22 07:06:11,349 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5822cdba7ce2a6e2: Processing first storage report for DS-0bfe3de8-2f3d-48bc-a618-dea3e910169c from datanode 3d25e4ce-7a2c-4c2c-952d-ee7f4ad0ae86 2023-07-22 07:06:11,350 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5822cdba7ce2a6e2: from storage DS-0bfe3de8-2f3d-48bc-a618-dea3e910169c node DatanodeRegistration(127.0.0.1:39861, datanodeUuid=3d25e4ce-7a2c-4c2c-952d-ee7f4ad0ae86, infoPort=35073, infoSecurePort=0, ipcPort=45423, storageInfo=lv=-57;cid=testClusterID;nsid=1204795166;c=1690009568512), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-22 07:06:11,350 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe02d5772bb9d0ade: Processing first storage report for DS-b5915506-33a7-4d63-b35f-0644c43d0cf9 from datanode 793ad59e-b149-4edf-8edb-f9c772982824 2023-07-22 07:06:11,351 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe02d5772bb9d0ade: from storage DS-b5915506-33a7-4d63-b35f-0644c43d0cf9 node DatanodeRegistration(127.0.0.1:38031, datanodeUuid=793ad59e-b149-4edf-8edb-f9c772982824, infoPort=38129, infoSecurePort=0, ipcPort=42909, storageInfo=lv=-57;cid=testClusterID;nsid=1204795166;c=1690009568512), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-22 07:06:11,351 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x81b82d0ea965758c: Processing first storage report for DS-9823f657-1cab-4f4c-9f83-f2632ab5be4f from datanode b58c9f20-69f4-4098-a29d-71c12173dfb4 2023-07-22 07:06:11,351 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x81b82d0ea965758c: from storage DS-9823f657-1cab-4f4c-9f83-f2632ab5be4f node DatanodeRegistration(127.0.0.1:35335, datanodeUuid=b58c9f20-69f4-4098-a29d-71c12173dfb4, infoPort=37267, infoSecurePort=0, ipcPort=34487, storageInfo=lv=-57;cid=testClusterID;nsid=1204795166;c=1690009568512), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-22 07:06:11,351 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5822cdba7ce2a6e2: Processing first storage report for DS-360b2d53-712c-4068-a3a9-f817ed366b53 from datanode 3d25e4ce-7a2c-4c2c-952d-ee7f4ad0ae86 2023-07-22 07:06:11,351 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5822cdba7ce2a6e2: from storage DS-360b2d53-712c-4068-a3a9-f817ed366b53 node DatanodeRegistration(127.0.0.1:39861, datanodeUuid=3d25e4ce-7a2c-4c2c-952d-ee7f4ad0ae86, infoPort=35073, infoSecurePort=0, ipcPort=45423, storageInfo=lv=-57;cid=testClusterID;nsid=1204795166;c=1690009568512), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-22 07:06:11,351 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe02d5772bb9d0ade: Processing first storage report for DS-131d89e2-34c1-4874-95bf-70ab3015d7bc from datanode 793ad59e-b149-4edf-8edb-f9c772982824 2023-07-22 07:06:11,351 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe02d5772bb9d0ade: from storage DS-131d89e2-34c1-4874-95bf-70ab3015d7bc node DatanodeRegistration(127.0.0.1:38031, datanodeUuid=793ad59e-b149-4edf-8edb-f9c772982824, infoPort=38129, infoSecurePort=0, ipcPort=42909, storageInfo=lv=-57;cid=testClusterID;nsid=1204795166;c=1690009568512), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-22 07:06:11,351 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x81b82d0ea965758c: Processing first storage report for DS-2da4dc43-b672-4892-8238-42115d4c822e from datanode b58c9f20-69f4-4098-a29d-71c12173dfb4 2023-07-22 07:06:11,352 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x81b82d0ea965758c: from storage DS-2da4dc43-b672-4892-8238-42115d4c822e node DatanodeRegistration(127.0.0.1:35335, datanodeUuid=b58c9f20-69f4-4098-a29d-71c12173dfb4, infoPort=37267, infoSecurePort=0, ipcPort=34487, storageInfo=lv=-57;cid=testClusterID;nsid=1204795166;c=1690009568512), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-22 07:06:11,541 DEBUG [Listener at localhost/45423] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19 2023-07-22 07:06:11,640 INFO [Listener at localhost/45423] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/cluster_09dad59a-c8af-d239-c3a5-237708feddb2/zookeeper_0, clientPort=63277, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/cluster_09dad59a-c8af-d239-c3a5-237708feddb2/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/cluster_09dad59a-c8af-d239-c3a5-237708feddb2/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-22 07:06:11,657 INFO [Listener at localhost/45423] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=63277 2023-07-22 07:06:11,669 INFO [Listener at localhost/45423] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 07:06:11,672 INFO [Listener at localhost/45423] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 07:06:12,360 INFO [Listener at localhost/45423] util.FSUtils(471): Created version file at hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03 with version=8 2023-07-22 07:06:12,360 INFO [Listener at localhost/45423] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/hbase-staging 2023-07-22 07:06:12,746 INFO [Listener at localhost/45423] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-22 07:06:13,470 INFO [Listener at localhost/45423] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-22 07:06:13,520 INFO [Listener at localhost/45423] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 07:06:13,521 INFO [Listener at localhost/45423] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-22 07:06:13,521 INFO [Listener at localhost/45423] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-22 07:06:13,521 INFO [Listener at localhost/45423] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 07:06:13,522 INFO [Listener at localhost/45423] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-22 07:06:13,689 INFO [Listener at localhost/45423] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-22 07:06:13,779 DEBUG [Listener at localhost/45423] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-22 07:06:13,919 INFO [Listener at localhost/45423] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44609 2023-07-22 07:06:13,934 INFO [Listener at localhost/45423] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 07:06:13,937 INFO [Listener at localhost/45423] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 07:06:13,960 INFO [Listener at localhost/45423] zookeeper.RecoverableZooKeeper(93): Process identifier=master:44609 connecting to ZooKeeper ensemble=127.0.0.1:63277 2023-07-22 07:06:14,013 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:446090x0, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-22 07:06:14,020 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:44609-0x1018bda14210000 connected 2023-07-22 07:06:14,064 DEBUG [Listener at localhost/45423] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-22 07:06:14,065 DEBUG [Listener at localhost/45423] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 07:06:14,080 DEBUG [Listener at localhost/45423] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-22 07:06:14,088 DEBUG [Listener at localhost/45423] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44609 2023-07-22 07:06:14,088 DEBUG [Listener at localhost/45423] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44609 2023-07-22 07:06:14,089 DEBUG [Listener at localhost/45423] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44609 2023-07-22 07:06:14,090 DEBUG [Listener at localhost/45423] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44609 2023-07-22 07:06:14,090 DEBUG [Listener at localhost/45423] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44609 2023-07-22 07:06:14,097 INFO [Listener at localhost/45423] master.HMaster(444): hbase.rootdir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03, hbase.cluster.distributed=false 2023-07-22 07:06:14,174 INFO [Listener at localhost/45423] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-22 07:06:14,175 INFO [Listener at localhost/45423] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 07:06:14,175 INFO [Listener at localhost/45423] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-22 07:06:14,175 INFO [Listener at localhost/45423] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-22 07:06:14,175 INFO [Listener at localhost/45423] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 07:06:14,175 INFO [Listener at localhost/45423] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-22 07:06:14,181 INFO [Listener at localhost/45423] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-22 07:06:14,187 INFO [Listener at localhost/45423] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34707 2023-07-22 07:06:14,191 INFO [Listener at localhost/45423] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-22 07:06:14,206 INFO [Listener at localhost/45423] mob.MobFileCache(124): MobFileCache disabled 2023-07-22 07:06:14,208 INFO [Listener at localhost/45423] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 07:06:14,211 INFO [Listener at localhost/45423] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 07:06:14,213 INFO [Listener at localhost/45423] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34707 connecting to ZooKeeper ensemble=127.0.0.1:63277 2023-07-22 07:06:14,224 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:347070x0, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-22 07:06:14,225 DEBUG [Listener at localhost/45423] zookeeper.ZKUtil(164): regionserver:347070x0, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-22 07:06:14,226 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34707-0x1018bda14210001 connected 2023-07-22 07:06:14,230 DEBUG [Listener at localhost/45423] zookeeper.ZKUtil(164): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 07:06:14,232 DEBUG [Listener at localhost/45423] zookeeper.ZKUtil(164): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-22 07:06:14,235 DEBUG [Listener at localhost/45423] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34707 2023-07-22 07:06:14,238 DEBUG [Listener at localhost/45423] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34707 2023-07-22 07:06:14,239 DEBUG [Listener at localhost/45423] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34707 2023-07-22 07:06:14,243 DEBUG [Listener at localhost/45423] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34707 2023-07-22 07:06:14,246 DEBUG [Listener at localhost/45423] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34707 2023-07-22 07:06:14,261 INFO [Listener at localhost/45423] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-22 07:06:14,261 INFO [Listener at localhost/45423] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 07:06:14,262 INFO [Listener at localhost/45423] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-22 07:06:14,262 INFO [Listener at localhost/45423] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-22 07:06:14,262 INFO [Listener at localhost/45423] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 07:06:14,262 INFO [Listener at localhost/45423] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-22 07:06:14,263 INFO [Listener at localhost/45423] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-22 07:06:14,264 INFO [Listener at localhost/45423] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44269 2023-07-22 07:06:14,265 INFO [Listener at localhost/45423] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-22 07:06:14,268 INFO [Listener at localhost/45423] mob.MobFileCache(124): MobFileCache disabled 2023-07-22 07:06:14,269 INFO [Listener at localhost/45423] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 07:06:14,272 INFO [Listener at localhost/45423] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 07:06:14,283 INFO [Listener at localhost/45423] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44269 connecting to ZooKeeper ensemble=127.0.0.1:63277 2023-07-22 07:06:14,291 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:442690x0, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-22 07:06:14,292 DEBUG [Listener at localhost/45423] zookeeper.ZKUtil(164): regionserver:442690x0, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-22 07:06:14,293 DEBUG [Listener at localhost/45423] zookeeper.ZKUtil(164): regionserver:442690x0, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 07:06:14,294 DEBUG [Listener at localhost/45423] zookeeper.ZKUtil(164): regionserver:442690x0, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-22 07:06:14,302 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44269-0x1018bda14210002 connected 2023-07-22 07:06:14,306 DEBUG [Listener at localhost/45423] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44269 2023-07-22 07:06:14,307 DEBUG [Listener at localhost/45423] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44269 2023-07-22 07:06:14,307 DEBUG [Listener at localhost/45423] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44269 2023-07-22 07:06:14,315 DEBUG [Listener at localhost/45423] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44269 2023-07-22 07:06:14,315 DEBUG [Listener at localhost/45423] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44269 2023-07-22 07:06:14,334 INFO [Listener at localhost/45423] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-22 07:06:14,334 INFO [Listener at localhost/45423] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 07:06:14,334 INFO [Listener at localhost/45423] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-22 07:06:14,334 INFO [Listener at localhost/45423] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-22 07:06:14,334 INFO [Listener at localhost/45423] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 07:06:14,335 INFO [Listener at localhost/45423] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-22 07:06:14,335 INFO [Listener at localhost/45423] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-22 07:06:14,340 INFO [Listener at localhost/45423] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43271 2023-07-22 07:06:14,340 INFO [Listener at localhost/45423] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-22 07:06:14,342 INFO [Listener at localhost/45423] mob.MobFileCache(124): MobFileCache disabled 2023-07-22 07:06:14,344 INFO [Listener at localhost/45423] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 07:06:14,346 INFO [Listener at localhost/45423] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 07:06:14,348 INFO [Listener at localhost/45423] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43271 connecting to ZooKeeper ensemble=127.0.0.1:63277 2023-07-22 07:06:14,352 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:432710x0, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-22 07:06:14,353 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43271-0x1018bda14210003 connected 2023-07-22 07:06:14,353 DEBUG [Listener at localhost/45423] zookeeper.ZKUtil(164): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-22 07:06:14,354 DEBUG [Listener at localhost/45423] zookeeper.ZKUtil(164): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 07:06:14,355 DEBUG [Listener at localhost/45423] zookeeper.ZKUtil(164): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-22 07:06:14,359 DEBUG [Listener at localhost/45423] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43271 2023-07-22 07:06:14,360 DEBUG [Listener at localhost/45423] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43271 2023-07-22 07:06:14,370 DEBUG [Listener at localhost/45423] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43271 2023-07-22 07:06:14,379 DEBUG [Listener at localhost/45423] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43271 2023-07-22 07:06:14,386 DEBUG [Listener at localhost/45423] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43271 2023-07-22 07:06:14,392 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,44609,1690009572558 2023-07-22 07:06:14,404 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-22 07:06:14,406 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,44609,1690009572558 2023-07-22 07:06:14,435 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-22 07:06:14,435 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-22 07:06:14,435 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-22 07:06:14,435 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 07:06:14,435 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-22 07:06:14,437 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-22 07:06:14,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,44609,1690009572558 from backup master directory 2023-07-22 07:06:14,438 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-22 07:06:14,443 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,44609,1690009572558 2023-07-22 07:06:14,443 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-22 07:06:14,444 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-22 07:06:14,445 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,44609,1690009572558 2023-07-22 07:06:14,449 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-22 07:06:14,455 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-22 07:06:14,590 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/hbase.id with ID: 9e965943-96a1-43f0-ad67-3208cd277d4a 2023-07-22 07:06:14,646 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 07:06:14,661 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 07:06:14,728 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x3efff31b to 127.0.0.1:63277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 07:06:14,771 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@606dd9fd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 07:06:14,805 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-22 07:06:14,808 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-22 07:06:14,831 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-22 07:06:14,831 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-22 07:06:14,833 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-22 07:06:14,838 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-22 07:06:14,840 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-22 07:06:14,892 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/MasterData/data/master/store-tmp 2023-07-22 07:06:14,963 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 07:06:14,963 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-22 07:06:14,963 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 07:06:14,963 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 07:06:14,963 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-22 07:06:14,963 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 07:06:14,964 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 07:06:14,964 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-22 07:06:14,966 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/MasterData/WALs/jenkins-hbase4.apache.org,44609,1690009572558 2023-07-22 07:06:14,991 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44609%2C1690009572558, suffix=, logDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/MasterData/WALs/jenkins-hbase4.apache.org,44609,1690009572558, archiveDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/MasterData/oldWALs, maxLogs=10 2023-07-22 07:06:15,072 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38031,DS-b5915506-33a7-4d63-b35f-0644c43d0cf9,DISK] 2023-07-22 07:06:15,072 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39861,DS-0bfe3de8-2f3d-48bc-a618-dea3e910169c,DISK] 2023-07-22 07:06:15,072 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35335,DS-9823f657-1cab-4f4c-9f83-f2632ab5be4f,DISK] 2023-07-22 07:06:15,085 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-22 07:06:15,181 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/MasterData/WALs/jenkins-hbase4.apache.org,44609,1690009572558/jenkins-hbase4.apache.org%2C44609%2C1690009572558.1690009575003 2023-07-22 07:06:15,182 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38031,DS-b5915506-33a7-4d63-b35f-0644c43d0cf9,DISK], DatanodeInfoWithStorage[127.0.0.1:35335,DS-9823f657-1cab-4f4c-9f83-f2632ab5be4f,DISK], DatanodeInfoWithStorage[127.0.0.1:39861,DS-0bfe3de8-2f3d-48bc-a618-dea3e910169c,DISK]] 2023-07-22 07:06:15,183 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-22 07:06:15,183 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 07:06:15,188 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-22 07:06:15,189 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-22 07:06:15,263 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-22 07:06:15,270 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-22 07:06:15,301 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-22 07:06:15,320 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 07:06:15,328 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-22 07:06:15,330 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-22 07:06:15,351 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-22 07:06:15,357 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 07:06:15,358 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68686322, jitterRate=0.023505955934524536}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 07:06:15,358 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-22 07:06:15,359 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-22 07:06:15,384 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-22 07:06:15,384 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-22 07:06:15,387 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-22 07:06:15,389 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-22 07:06:15,430 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 41 msec 2023-07-22 07:06:15,431 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-22 07:06:15,466 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-22 07:06:15,476 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-22 07:06:15,505 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-22 07:06:15,510 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-22 07:06:15,511 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-22 07:06:15,518 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-22 07:06:15,524 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-22 07:06:15,528 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 07:06:15,534 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-22 07:06:15,535 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-22 07:06:15,555 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-22 07:06:15,561 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-22 07:06:15,561 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-22 07:06:15,561 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-22 07:06:15,561 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-22 07:06:15,562 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 07:06:15,562 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,44609,1690009572558, sessionid=0x1018bda14210000, setting cluster-up flag (Was=false) 2023-07-22 07:06:15,587 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 07:06:15,597 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-22 07:06:15,600 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44609,1690009572558 2023-07-22 07:06:15,606 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 07:06:15,613 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-22 07:06:15,615 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44609,1690009572558 2023-07-22 07:06:15,618 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp 2023-07-22 07:06:15,695 INFO [RS:1;jenkins-hbase4:44269] regionserver.HRegionServer(951): ClusterId : 9e965943-96a1-43f0-ad67-3208cd277d4a 2023-07-22 07:06:15,705 INFO [RS:0;jenkins-hbase4:34707] regionserver.HRegionServer(951): ClusterId : 9e965943-96a1-43f0-ad67-3208cd277d4a 2023-07-22 07:06:15,703 INFO [RS:2;jenkins-hbase4:43271] regionserver.HRegionServer(951): ClusterId : 9e965943-96a1-43f0-ad67-3208cd277d4a 2023-07-22 07:06:15,706 DEBUG [RS:0;jenkins-hbase4:34707] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-22 07:06:15,708 DEBUG [RS:1;jenkins-hbase4:44269] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-22 07:06:15,706 DEBUG [RS:2;jenkins-hbase4:43271] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-22 07:06:15,717 DEBUG [RS:0;jenkins-hbase4:34707] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-22 07:06:15,717 DEBUG [RS:0;jenkins-hbase4:34707] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-22 07:06:15,717 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-22 07:06:15,718 DEBUG [RS:2;jenkins-hbase4:43271] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-22 07:06:15,718 DEBUG [RS:2;jenkins-hbase4:43271] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-22 07:06:15,718 DEBUG [RS:1;jenkins-hbase4:44269] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-22 07:06:15,719 DEBUG [RS:1;jenkins-hbase4:44269] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-22 07:06:15,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 07:06:15,724 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-22 07:06:15,724 DEBUG [RS:0;jenkins-hbase4:34707] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-22 07:06:15,726 DEBUG [RS:0;jenkins-hbase4:34707] zookeeper.ReadOnlyZKClient(139): Connect 0x6f48a187 to 127.0.0.1:63277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 07:06:15,727 DEBUG [RS:1;jenkins-hbase4:44269] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-22 07:06:15,728 DEBUG [RS:1;jenkins-hbase4:44269] zookeeper.ReadOnlyZKClient(139): Connect 0x3b7512a5 to 127.0.0.1:63277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 07:06:15,728 DEBUG [RS:2;jenkins-hbase4:43271] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-22 07:06:15,736 DEBUG [RS:2;jenkins-hbase4:43271] zookeeper.ReadOnlyZKClient(139): Connect 0x6465126b to 127.0.0.1:63277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 07:06:15,752 DEBUG [RS:0;jenkins-hbase4:34707] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a833013, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 07:06:15,753 DEBUG [RS:1;jenkins-hbase4:44269] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@640bb926, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 07:06:15,753 DEBUG [RS:0;jenkins-hbase4:34707] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c4e18f1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-22 07:06:15,753 DEBUG [RS:1;jenkins-hbase4:44269] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@632d9ae2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-22 07:06:15,784 DEBUG [RS:2;jenkins-hbase4:43271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6aa2e097, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 07:06:15,785 DEBUG [RS:2;jenkins-hbase4:43271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b9feaac, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-22 07:06:15,796 DEBUG [RS:0;jenkins-hbase4:34707] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:34707 2023-07-22 07:06:15,799 DEBUG [RS:1;jenkins-hbase4:44269] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:44269 2023-07-22 07:06:15,803 INFO [RS:0;jenkins-hbase4:34707] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-22 07:06:15,804 INFO [RS:0;jenkins-hbase4:34707] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-22 07:06:15,811 DEBUG [RS:0;jenkins-hbase4:34707] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-22 07:06:15,812 DEBUG [RS:2;jenkins-hbase4:43271] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:43271 2023-07-22 07:06:15,813 INFO [RS:2;jenkins-hbase4:43271] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-22 07:06:15,813 INFO [RS:2;jenkins-hbase4:43271] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-22 07:06:15,813 DEBUG [RS:2;jenkins-hbase4:43271] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-22 07:06:15,803 INFO [RS:1;jenkins-hbase4:44269] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-22 07:06:15,814 INFO [RS:1;jenkins-hbase4:44269] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-22 07:06:15,814 DEBUG [RS:1;jenkins-hbase4:44269] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-22 07:06:15,814 INFO [RS:0;jenkins-hbase4:34707] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 07:06:15,815 INFO [RS:2;jenkins-hbase4:43271] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 07:06:15,815 DEBUG [RS:2;jenkins-hbase4:43271] regionserver.HRegionServer(1022): About to register with Master. 2023-07-22 07:06:15,815 DEBUG [RS:0;jenkins-hbase4:34707] regionserver.HRegionServer(1022): About to register with Master. 2023-07-22 07:06:15,814 INFO [RS:1;jenkins-hbase4:44269] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 07:06:15,815 DEBUG [RS:1;jenkins-hbase4:44269] regionserver.HRegionServer(1022): About to register with Master. 2023-07-22 07:06:15,818 INFO [RS:1;jenkins-hbase4:44269] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44609,1690009572558 with isa=jenkins-hbase4.apache.org/172.31.14.131:44269, startcode=1690009574260 2023-07-22 07:06:15,818 INFO [RS:0;jenkins-hbase4:34707] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44609,1690009572558 with isa=jenkins-hbase4.apache.org/172.31.14.131:34707, startcode=1690009574173 2023-07-22 07:06:15,818 INFO [RS:2;jenkins-hbase4:43271] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44609,1690009572558 with isa=jenkins-hbase4.apache.org/172.31.14.131:43271, startcode=1690009574333 2023-07-22 07:06:15,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-22 07:06:15,838 DEBUG [RS:2;jenkins-hbase4:43271] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-22 07:06:15,838 DEBUG [RS:1;jenkins-hbase4:44269] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-22 07:06:15,841 DEBUG [RS:0;jenkins-hbase4:34707] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-22 07:06:15,849 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-22 07:06:15,850 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-22 07:06:15,850 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-22 07:06:15,850 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-22 07:06:15,850 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-22 07:06:15,850 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 07:06:15,850 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-22 07:06:15,850 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 07:06:15,864 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1690009605864 2023-07-22 07:06:15,867 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-22 07:06:15,883 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-22 07:06:15,883 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-22 07:06:15,884 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-22 07:06:15,892 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-22 07:06:15,897 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-22 07:06:15,898 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-22 07:06:15,898 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-22 07:06:15,898 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-22 07:06:15,904 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-22 07:06:15,907 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-22 07:06:15,910 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-22 07:06:15,910 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-22 07:06:15,919 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-22 07:06:15,919 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-22 07:06:15,921 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690009575921,5,FailOnTimeoutGroup] 2023-07-22 07:06:15,921 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36471, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-22 07:06:15,922 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41911, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-22 07:06:15,922 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58339, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-22 07:06:15,922 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690009575922,5,FailOnTimeoutGroup] 2023-07-22 07:06:15,924 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-22 07:06:15,924 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-22 07:06:15,926 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-22 07:06:15,927 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-22 07:06:15,940 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44609] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:15,974 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44609] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:15,982 DEBUG [RS:2;jenkins-hbase4:43271] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03 2023-07-22 07:06:15,982 DEBUG [RS:2;jenkins-hbase4:43271] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:45491 2023-07-22 07:06:15,982 DEBUG [RS:2;jenkins-hbase4:43271] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-22 07:06:15,982 DEBUG [RS:0;jenkins-hbase4:34707] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03 2023-07-22 07:06:15,983 DEBUG [RS:0;jenkins-hbase4:34707] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:45491 2023-07-22 07:06:15,983 DEBUG [RS:0;jenkins-hbase4:34707] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-22 07:06:15,987 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44609] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:15,990 DEBUG [RS:1;jenkins-hbase4:44269] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03 2023-07-22 07:06:15,990 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-22 07:06:15,990 DEBUG [RS:1;jenkins-hbase4:44269] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:45491 2023-07-22 07:06:15,990 DEBUG [RS:1;jenkins-hbase4:44269] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-22 07:06:15,991 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-22 07:06:15,992 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03 2023-07-22 07:06:15,993 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 07:06:15,994 DEBUG [RS:2;jenkins-hbase4:43271] zookeeper.ZKUtil(162): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:15,995 DEBUG [RS:0;jenkins-hbase4:34707] zookeeper.ZKUtil(162): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:15,995 DEBUG [RS:1;jenkins-hbase4:44269] zookeeper.ZKUtil(162): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:15,995 WARN [RS:0;jenkins-hbase4:34707] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-22 07:06:15,995 WARN [RS:2;jenkins-hbase4:43271] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-22 07:06:15,997 INFO [RS:0;jenkins-hbase4:34707] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-22 07:06:15,997 DEBUG [RS:0;jenkins-hbase4:34707] regionserver.HRegionServer(1948): logDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/WALs/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:15,995 WARN [RS:1;jenkins-hbase4:44269] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-22 07:06:16,001 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34707,1690009574173] 2023-07-22 07:06:16,002 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43271,1690009574333] 2023-07-22 07:06:16,002 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44269,1690009574260] 2023-07-22 07:06:15,997 INFO [RS:2;jenkins-hbase4:43271] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-22 07:06:15,999 INFO [RS:1;jenkins-hbase4:44269] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-22 07:06:16,008 DEBUG [RS:2;jenkins-hbase4:43271] regionserver.HRegionServer(1948): logDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/WALs/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:16,008 DEBUG [RS:1;jenkins-hbase4:44269] regionserver.HRegionServer(1948): logDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/WALs/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:16,068 DEBUG [RS:1;jenkins-hbase4:44269] zookeeper.ZKUtil(162): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:16,069 DEBUG [RS:2;jenkins-hbase4:43271] zookeeper.ZKUtil(162): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:16,069 DEBUG [RS:1;jenkins-hbase4:44269] zookeeper.ZKUtil(162): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:16,069 DEBUG [RS:0;jenkins-hbase4:34707] zookeeper.ZKUtil(162): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:16,070 DEBUG [RS:2;jenkins-hbase4:43271] zookeeper.ZKUtil(162): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:16,070 DEBUG [RS:1;jenkins-hbase4:44269] zookeeper.ZKUtil(162): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:16,070 DEBUG [RS:0;jenkins-hbase4:34707] zookeeper.ZKUtil(162): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:16,071 DEBUG [RS:2;jenkins-hbase4:43271] zookeeper.ZKUtil(162): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:16,074 DEBUG [RS:0;jenkins-hbase4:34707] zookeeper.ZKUtil(162): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:16,095 DEBUG [RS:0;jenkins-hbase4:34707] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-22 07:06:16,095 DEBUG [RS:1;jenkins-hbase4:44269] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-22 07:06:16,095 DEBUG [RS:2;jenkins-hbase4:43271] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-22 07:06:16,109 INFO [RS:2;jenkins-hbase4:43271] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-22 07:06:16,130 INFO [RS:1;jenkins-hbase4:44269] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-22 07:06:16,132 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 07:06:16,130 INFO [RS:0;jenkins-hbase4:34707] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-22 07:06:16,150 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-22 07:06:16,154 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/meta/1588230740/info 2023-07-22 07:06:16,155 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-22 07:06:16,156 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 07:06:16,157 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-22 07:06:16,161 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/meta/1588230740/rep_barrier 2023-07-22 07:06:16,161 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-22 07:06:16,163 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 07:06:16,163 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-22 07:06:16,164 INFO [RS:1;jenkins-hbase4:44269] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-22 07:06:16,171 INFO [RS:2;jenkins-hbase4:43271] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-22 07:06:16,166 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/meta/1588230740/table 2023-07-22 07:06:16,192 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-22 07:06:16,195 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 07:06:16,201 INFO [RS:0;jenkins-hbase4:34707] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-22 07:06:16,205 INFO [RS:2;jenkins-hbase4:43271] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-22 07:06:16,206 INFO [RS:2;jenkins-hbase4:43271] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 07:06:16,206 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/meta/1588230740 2023-07-22 07:06:16,207 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/meta/1588230740 2023-07-22 07:06:16,216 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-22 07:06:16,205 INFO [RS:1;jenkins-hbase4:44269] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-22 07:06:16,219 INFO [RS:0;jenkins-hbase4:34707] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-22 07:06:16,222 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-22 07:06:16,220 INFO [RS:1;jenkins-hbase4:44269] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 07:06:16,237 INFO [RS:2;jenkins-hbase4:43271] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-22 07:06:16,220 INFO [RS:0;jenkins-hbase4:34707] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 07:06:16,245 INFO [RS:1;jenkins-hbase4:44269] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-22 07:06:16,245 INFO [RS:0;jenkins-hbase4:34707] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-22 07:06:16,245 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 07:06:16,248 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73218894, jitterRate=0.091046541929245}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-22 07:06:16,249 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-22 07:06:16,249 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-22 07:06:16,249 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-22 07:06:16,249 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-22 07:06:16,249 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-22 07:06:16,249 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-22 07:06:16,262 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-22 07:06:16,263 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-22 07:06:16,269 INFO [RS:1;jenkins-hbase4:44269] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-22 07:06:16,269 INFO [RS:0;jenkins-hbase4:34707] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-22 07:06:16,270 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-22 07:06:16,270 DEBUG [RS:0;jenkins-hbase4:34707] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 07:06:16,269 INFO [RS:2;jenkins-hbase4:43271] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-22 07:06:16,270 DEBUG [RS:0;jenkins-hbase4:34707] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 07:06:16,270 DEBUG [RS:1;jenkins-hbase4:44269] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 07:06:16,271 DEBUG [RS:2;jenkins-hbase4:43271] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 07:06:16,270 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-22 07:06:16,271 DEBUG [RS:2;jenkins-hbase4:43271] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 07:06:16,271 DEBUG [RS:1;jenkins-hbase4:44269] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 07:06:16,271 DEBUG [RS:0;jenkins-hbase4:34707] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 07:06:16,271 DEBUG [RS:1;jenkins-hbase4:44269] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 07:06:16,271 DEBUG [RS:0;jenkins-hbase4:34707] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 07:06:16,271 DEBUG [RS:1;jenkins-hbase4:44269] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 07:06:16,271 DEBUG [RS:0;jenkins-hbase4:34707] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 07:06:16,271 DEBUG [RS:1;jenkins-hbase4:44269] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 07:06:16,271 DEBUG [RS:0;jenkins-hbase4:34707] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-22 07:06:16,271 DEBUG [RS:1;jenkins-hbase4:44269] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-22 07:06:16,271 DEBUG [RS:0;jenkins-hbase4:34707] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 07:06:16,272 DEBUG [RS:1;jenkins-hbase4:44269] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 07:06:16,272 DEBUG [RS:0;jenkins-hbase4:34707] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 07:06:16,272 DEBUG [RS:1;jenkins-hbase4:44269] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 07:06:16,272 DEBUG [RS:0;jenkins-hbase4:34707] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 07:06:16,272 DEBUG [RS:1;jenkins-hbase4:44269] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 07:06:16,272 DEBUG [RS:0;jenkins-hbase4:34707] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 07:06:16,272 DEBUG [RS:1;jenkins-hbase4:44269] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 07:06:16,271 DEBUG [RS:2;jenkins-hbase4:43271] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 07:06:16,272 DEBUG [RS:2;jenkins-hbase4:43271] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 07:06:16,272 DEBUG [RS:2;jenkins-hbase4:43271] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 07:06:16,273 DEBUG [RS:2;jenkins-hbase4:43271] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-22 07:06:16,273 DEBUG [RS:2;jenkins-hbase4:43271] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 07:06:16,273 DEBUG [RS:2;jenkins-hbase4:43271] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 07:06:16,273 DEBUG [RS:2;jenkins-hbase4:43271] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 07:06:16,273 DEBUG [RS:2;jenkins-hbase4:43271] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 07:06:16,284 INFO [RS:2;jenkins-hbase4:43271] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-22 07:06:16,284 INFO [RS:2;jenkins-hbase4:43271] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-22 07:06:16,284 INFO [RS:2;jenkins-hbase4:43271] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-22 07:06:16,284 INFO [RS:0;jenkins-hbase4:34707] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-22 07:06:16,285 INFO [RS:0;jenkins-hbase4:34707] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-22 07:06:16,285 INFO [RS:0;jenkins-hbase4:34707] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-22 07:06:16,285 INFO [RS:1;jenkins-hbase4:44269] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-22 07:06:16,285 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-22 07:06:16,286 INFO [RS:1;jenkins-hbase4:44269] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-22 07:06:16,286 INFO [RS:1;jenkins-hbase4:44269] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-22 07:06:16,308 INFO [RS:0;jenkins-hbase4:34707] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-22 07:06:16,311 INFO [RS:0;jenkins-hbase4:34707] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34707,1690009574173-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 07:06:16,309 INFO [RS:2;jenkins-hbase4:43271] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-22 07:06:16,314 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-22 07:06:16,315 INFO [RS:2;jenkins-hbase4:43271] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43271,1690009574333-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 07:06:16,310 INFO [RS:1;jenkins-hbase4:44269] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-22 07:06:16,317 INFO [RS:1;jenkins-hbase4:44269] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44269,1690009574260-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 07:06:16,319 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-22 07:06:16,337 INFO [RS:0;jenkins-hbase4:34707] regionserver.Replication(203): jenkins-hbase4.apache.org,34707,1690009574173 started 2023-07-22 07:06:16,338 INFO [RS:0;jenkins-hbase4:34707] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,34707,1690009574173, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34707, sessionid=0x1018bda14210001 2023-07-22 07:06:16,340 INFO [RS:2;jenkins-hbase4:43271] regionserver.Replication(203): jenkins-hbase4.apache.org,43271,1690009574333 started 2023-07-22 07:06:16,340 INFO [RS:2;jenkins-hbase4:43271] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,43271,1690009574333, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43271, sessionid=0x1018bda14210003 2023-07-22 07:06:16,341 DEBUG [RS:2;jenkins-hbase4:43271] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-22 07:06:16,341 DEBUG [RS:2;jenkins-hbase4:43271] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:16,341 DEBUG [RS:2;jenkins-hbase4:43271] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43271,1690009574333' 2023-07-22 07:06:16,341 DEBUG [RS:2;jenkins-hbase4:43271] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-22 07:06:16,341 INFO [RS:1;jenkins-hbase4:44269] regionserver.Replication(203): jenkins-hbase4.apache.org,44269,1690009574260 started 2023-07-22 07:06:16,341 INFO [RS:1;jenkins-hbase4:44269] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,44269,1690009574260, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44269, sessionid=0x1018bda14210002 2023-07-22 07:06:16,341 DEBUG [RS:1;jenkins-hbase4:44269] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-22 07:06:16,341 DEBUG [RS:1;jenkins-hbase4:44269] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:16,342 DEBUG [RS:0;jenkins-hbase4:34707] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-22 07:06:16,342 DEBUG [RS:0;jenkins-hbase4:34707] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:16,343 DEBUG [RS:2;jenkins-hbase4:43271] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-22 07:06:16,342 DEBUG [RS:1;jenkins-hbase4:44269] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44269,1690009574260' 2023-07-22 07:06:16,343 DEBUG [RS:1;jenkins-hbase4:44269] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-22 07:06:16,342 DEBUG [RS:0;jenkins-hbase4:34707] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34707,1690009574173' 2023-07-22 07:06:16,344 DEBUG [RS:0;jenkins-hbase4:34707] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-22 07:06:16,344 DEBUG [RS:2;jenkins-hbase4:43271] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-22 07:06:16,344 DEBUG [RS:2;jenkins-hbase4:43271] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-22 07:06:16,344 DEBUG [RS:0;jenkins-hbase4:34707] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-22 07:06:16,344 DEBUG [RS:2;jenkins-hbase4:43271] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:16,344 DEBUG [RS:2;jenkins-hbase4:43271] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43271,1690009574333' 2023-07-22 07:06:16,344 DEBUG [RS:2;jenkins-hbase4:43271] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:06:16,345 DEBUG [RS:0;jenkins-hbase4:34707] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-22 07:06:16,345 DEBUG [RS:0;jenkins-hbase4:34707] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-22 07:06:16,345 DEBUG [RS:2;jenkins-hbase4:43271] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:06:16,345 DEBUG [RS:0;jenkins-hbase4:34707] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:16,347 DEBUG [RS:0;jenkins-hbase4:34707] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34707,1690009574173' 2023-07-22 07:06:16,348 DEBUG [RS:0;jenkins-hbase4:34707] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:06:16,350 DEBUG [RS:2;jenkins-hbase4:43271] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-22 07:06:16,350 INFO [RS:2;jenkins-hbase4:43271] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-22 07:06:16,350 INFO [RS:2;jenkins-hbase4:43271] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-22 07:06:16,350 DEBUG [RS:0;jenkins-hbase4:34707] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:06:16,350 DEBUG [RS:0;jenkins-hbase4:34707] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-22 07:06:16,353 DEBUG [RS:1;jenkins-hbase4:44269] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-22 07:06:16,353 DEBUG [RS:1;jenkins-hbase4:44269] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-22 07:06:16,353 DEBUG [RS:1;jenkins-hbase4:44269] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-22 07:06:16,353 DEBUG [RS:1;jenkins-hbase4:44269] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:16,353 DEBUG [RS:1;jenkins-hbase4:44269] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44269,1690009574260' 2023-07-22 07:06:16,353 DEBUG [RS:1;jenkins-hbase4:44269] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:06:16,354 DEBUG [RS:1;jenkins-hbase4:44269] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:06:16,354 DEBUG [RS:1;jenkins-hbase4:44269] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-22 07:06:16,355 INFO [RS:1;jenkins-hbase4:44269] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-22 07:06:16,355 INFO [RS:1;jenkins-hbase4:44269] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-22 07:06:16,351 INFO [RS:0;jenkins-hbase4:34707] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-22 07:06:16,357 INFO [RS:0;jenkins-hbase4:34707] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-22 07:06:16,463 INFO [RS:1;jenkins-hbase4:44269] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44269%2C1690009574260, suffix=, logDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/WALs/jenkins-hbase4.apache.org,44269,1690009574260, archiveDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/oldWALs, maxLogs=32 2023-07-22 07:06:16,465 INFO [RS:0;jenkins-hbase4:34707] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34707%2C1690009574173, suffix=, logDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/WALs/jenkins-hbase4.apache.org,34707,1690009574173, archiveDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/oldWALs, maxLogs=32 2023-07-22 07:06:16,473 DEBUG [jenkins-hbase4:44609] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-22 07:06:16,479 DEBUG [jenkins-hbase4:44609] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 07:06:16,489 INFO [RS:2;jenkins-hbase4:43271] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43271%2C1690009574333, suffix=, logDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/WALs/jenkins-hbase4.apache.org,43271,1690009574333, archiveDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/oldWALs, maxLogs=32 2023-07-22 07:06:16,495 DEBUG [jenkins-hbase4:44609] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 07:06:16,495 DEBUG [jenkins-hbase4:44609] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 07:06:16,495 DEBUG [jenkins-hbase4:44609] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 07:06:16,495 DEBUG [jenkins-hbase4:44609] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 07:06:16,499 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43271,1690009574333, state=OPENING 2023-07-22 07:06:16,510 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35335,DS-9823f657-1cab-4f4c-9f83-f2632ab5be4f,DISK] 2023-07-22 07:06:16,511 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39861,DS-0bfe3de8-2f3d-48bc-a618-dea3e910169c,DISK] 2023-07-22 07:06:16,512 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38031,DS-b5915506-33a7-4d63-b35f-0644c43d0cf9,DISK] 2023-07-22 07:06:16,512 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35335,DS-9823f657-1cab-4f4c-9f83-f2632ab5be4f,DISK] 2023-07-22 07:06:16,512 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39861,DS-0bfe3de8-2f3d-48bc-a618-dea3e910169c,DISK] 2023-07-22 07:06:16,513 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38031,DS-b5915506-33a7-4d63-b35f-0644c43d0cf9,DISK] 2023-07-22 07:06:16,516 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-22 07:06:16,517 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 07:06:16,518 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-22 07:06:16,528 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43271,1690009574333}] 2023-07-22 07:06:16,531 INFO [RS:0;jenkins-hbase4:34707] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/WALs/jenkins-hbase4.apache.org,34707,1690009574173/jenkins-hbase4.apache.org%2C34707%2C1690009574173.1690009576468 2023-07-22 07:06:16,531 INFO [RS:1;jenkins-hbase4:44269] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/WALs/jenkins-hbase4.apache.org,44269,1690009574260/jenkins-hbase4.apache.org%2C44269%2C1690009574260.1690009576467 2023-07-22 07:06:16,532 DEBUG [RS:0;jenkins-hbase4:34707] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35335,DS-9823f657-1cab-4f4c-9f83-f2632ab5be4f,DISK], DatanodeInfoWithStorage[127.0.0.1:39861,DS-0bfe3de8-2f3d-48bc-a618-dea3e910169c,DISK], DatanodeInfoWithStorage[127.0.0.1:38031,DS-b5915506-33a7-4d63-b35f-0644c43d0cf9,DISK]] 2023-07-22 07:06:16,534 DEBUG [RS:1;jenkins-hbase4:44269] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35335,DS-9823f657-1cab-4f4c-9f83-f2632ab5be4f,DISK], DatanodeInfoWithStorage[127.0.0.1:38031,DS-b5915506-33a7-4d63-b35f-0644c43d0cf9,DISK], DatanodeInfoWithStorage[127.0.0.1:39861,DS-0bfe3de8-2f3d-48bc-a618-dea3e910169c,DISK]] 2023-07-22 07:06:16,539 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39861,DS-0bfe3de8-2f3d-48bc-a618-dea3e910169c,DISK] 2023-07-22 07:06:16,545 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38031,DS-b5915506-33a7-4d63-b35f-0644c43d0cf9,DISK] 2023-07-22 07:06:16,553 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35335,DS-9823f657-1cab-4f4c-9f83-f2632ab5be4f,DISK] 2023-07-22 07:06:16,592 INFO [RS:2;jenkins-hbase4:43271] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/WALs/jenkins-hbase4.apache.org,43271,1690009574333/jenkins-hbase4.apache.org%2C43271%2C1690009574333.1690009576496 2023-07-22 07:06:16,592 DEBUG [RS:2;jenkins-hbase4:43271] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39861,DS-0bfe3de8-2f3d-48bc-a618-dea3e910169c,DISK], DatanodeInfoWithStorage[127.0.0.1:38031,DS-b5915506-33a7-4d63-b35f-0644c43d0cf9,DISK], DatanodeInfoWithStorage[127.0.0.1:35335,DS-9823f657-1cab-4f4c-9f83-f2632ab5be4f,DISK]] 2023-07-22 07:06:16,778 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:16,781 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-22 07:06:16,785 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59596, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-22 07:06:16,831 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-22 07:06:16,832 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-22 07:06:16,836 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43271%2C1690009574333.meta, suffix=.meta, logDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/WALs/jenkins-hbase4.apache.org,43271,1690009574333, archiveDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/oldWALs, maxLogs=32 2023-07-22 07:06:16,870 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38031,DS-b5915506-33a7-4d63-b35f-0644c43d0cf9,DISK] 2023-07-22 07:06:16,871 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35335,DS-9823f657-1cab-4f4c-9f83-f2632ab5be4f,DISK] 2023-07-22 07:06:16,872 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39861,DS-0bfe3de8-2f3d-48bc-a618-dea3e910169c,DISK] 2023-07-22 07:06:16,894 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/WALs/jenkins-hbase4.apache.org,43271,1690009574333/jenkins-hbase4.apache.org%2C43271%2C1690009574333.meta.1690009576837.meta 2023-07-22 07:06:16,895 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38031,DS-b5915506-33a7-4d63-b35f-0644c43d0cf9,DISK], DatanodeInfoWithStorage[127.0.0.1:39861,DS-0bfe3de8-2f3d-48bc-a618-dea3e910169c,DISK], DatanodeInfoWithStorage[127.0.0.1:35335,DS-9823f657-1cab-4f4c-9f83-f2632ab5be4f,DISK]] 2023-07-22 07:06:16,895 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-22 07:06:16,896 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-22 07:06:16,898 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 07:06:16,899 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-22 07:06:16,901 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-22 07:06:16,903 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-22 07:06:16,921 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-22 07:06:16,922 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 07:06:16,922 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-22 07:06:16,922 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-22 07:06:16,931 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-22 07:06:16,934 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/meta/1588230740/info 2023-07-22 07:06:16,934 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/meta/1588230740/info 2023-07-22 07:06:16,935 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-22 07:06:16,936 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 07:06:16,936 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-22 07:06:16,938 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/meta/1588230740/rep_barrier 2023-07-22 07:06:16,938 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/meta/1588230740/rep_barrier 2023-07-22 07:06:16,939 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-22 07:06:16,940 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 07:06:16,940 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-22 07:06:16,942 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/meta/1588230740/table 2023-07-22 07:06:16,942 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/meta/1588230740/table 2023-07-22 07:06:16,943 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-22 07:06:16,944 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 07:06:16,946 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/meta/1588230740 2023-07-22 07:06:16,950 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/meta/1588230740 2023-07-22 07:06:16,958 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-22 07:06:16,961 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-22 07:06:16,963 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72811650, jitterRate=0.0849781334400177}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-22 07:06:16,967 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-22 07:06:16,980 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1690009576766 2023-07-22 07:06:17,000 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-22 07:06:17,002 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-22 07:06:17,003 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43271,1690009574333, state=OPEN 2023-07-22 07:06:17,007 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-22 07:06:17,007 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-22 07:06:17,015 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-22 07:06:17,015 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43271,1690009574333 in 479 msec 2023-07-22 07:06:17,022 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-22 07:06:17,022 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 731 msec 2023-07-22 07:06:17,031 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.2920 sec 2023-07-22 07:06:17,032 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1690009577031, completionTime=-1 2023-07-22 07:06:17,032 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-22 07:06:17,033 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-22 07:06:17,115 DEBUG [hconnection-0x6ff205ea-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 07:06:17,119 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59604, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 07:06:17,145 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-22 07:06:17,145 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1690009637145 2023-07-22 07:06:17,145 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1690009697145 2023-07-22 07:06:17,146 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 113 msec 2023-07-22 07:06:17,181 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44609,1690009572558-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 07:06:17,181 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44609,1690009572558-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-22 07:06:17,181 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44609,1690009572558-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-22 07:06:17,184 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:44609, period=300000, unit=MILLISECONDS is enabled. 2023-07-22 07:06:17,185 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-22 07:06:17,194 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-22 07:06:17,207 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-22 07:06:17,209 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-22 07:06:17,224 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-22 07:06:17,227 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 07:06:17,231 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 07:06:17,261 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/hbase/namespace/cbb2a096252f6b642113307201fd6b04 2023-07-22 07:06:17,264 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/hbase/namespace/cbb2a096252f6b642113307201fd6b04 empty. 2023-07-22 07:06:17,265 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/hbase/namespace/cbb2a096252f6b642113307201fd6b04 2023-07-22 07:06:17,265 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-22 07:06:17,326 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-22 07:06:17,328 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => cbb2a096252f6b642113307201fd6b04, NAME => 'hbase:namespace,,1690009577208.cbb2a096252f6b642113307201fd6b04.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp 2023-07-22 07:06:17,356 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690009577208.cbb2a096252f6b642113307201fd6b04.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 07:06:17,357 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing cbb2a096252f6b642113307201fd6b04, disabling compactions & flushes 2023-07-22 07:06:17,357 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690009577208.cbb2a096252f6b642113307201fd6b04. 2023-07-22 07:06:17,357 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690009577208.cbb2a096252f6b642113307201fd6b04. 2023-07-22 07:06:17,357 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690009577208.cbb2a096252f6b642113307201fd6b04. after waiting 0 ms 2023-07-22 07:06:17,357 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690009577208.cbb2a096252f6b642113307201fd6b04. 2023-07-22 07:06:17,357 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690009577208.cbb2a096252f6b642113307201fd6b04. 2023-07-22 07:06:17,357 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for cbb2a096252f6b642113307201fd6b04: 2023-07-22 07:06:17,362 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 07:06:17,379 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1690009577208.cbb2a096252f6b642113307201fd6b04.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690009577365"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690009577365"}]},"ts":"1690009577365"} 2023-07-22 07:06:17,417 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-22 07:06:17,419 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 07:06:17,424 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690009577419"}]},"ts":"1690009577419"} 2023-07-22 07:06:17,429 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-22 07:06:17,433 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 07:06:17,435 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 07:06:17,435 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 07:06:17,435 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 07:06:17,435 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 07:06:17,438 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=cbb2a096252f6b642113307201fd6b04, ASSIGN}] 2023-07-22 07:06:17,442 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=cbb2a096252f6b642113307201fd6b04, ASSIGN 2023-07-22 07:06:17,444 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=cbb2a096252f6b642113307201fd6b04, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43271,1690009574333; forceNewPlan=false, retain=false 2023-07-22 07:06:17,596 INFO [jenkins-hbase4:44609] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-22 07:06:17,598 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=cbb2a096252f6b642113307201fd6b04, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:17,598 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1690009577208.cbb2a096252f6b642113307201fd6b04.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690009577597"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690009577597"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690009577597"}]},"ts":"1690009577597"} 2023-07-22 07:06:17,602 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure cbb2a096252f6b642113307201fd6b04, server=jenkins-hbase4.apache.org,43271,1690009574333}] 2023-07-22 07:06:17,765 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1690009577208.cbb2a096252f6b642113307201fd6b04. 2023-07-22 07:06:17,765 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cbb2a096252f6b642113307201fd6b04, NAME => 'hbase:namespace,,1690009577208.cbb2a096252f6b642113307201fd6b04.', STARTKEY => '', ENDKEY => ''} 2023-07-22 07:06:17,765 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1690009577208.cbb2a096252f6b642113307201fd6b04. service=AccessControlService 2023-07-22 07:06:17,766 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 07:06:17,767 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace cbb2a096252f6b642113307201fd6b04 2023-07-22 07:06:17,767 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690009577208.cbb2a096252f6b642113307201fd6b04.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 07:06:17,767 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cbb2a096252f6b642113307201fd6b04 2023-07-22 07:06:17,768 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cbb2a096252f6b642113307201fd6b04 2023-07-22 07:06:17,777 INFO [StoreOpener-cbb2a096252f6b642113307201fd6b04-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region cbb2a096252f6b642113307201fd6b04 2023-07-22 07:06:17,780 DEBUG [StoreOpener-cbb2a096252f6b642113307201fd6b04-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/namespace/cbb2a096252f6b642113307201fd6b04/info 2023-07-22 07:06:17,780 DEBUG [StoreOpener-cbb2a096252f6b642113307201fd6b04-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/namespace/cbb2a096252f6b642113307201fd6b04/info 2023-07-22 07:06:17,781 INFO [StoreOpener-cbb2a096252f6b642113307201fd6b04-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cbb2a096252f6b642113307201fd6b04 columnFamilyName info 2023-07-22 07:06:17,782 INFO [StoreOpener-cbb2a096252f6b642113307201fd6b04-1] regionserver.HStore(310): Store=cbb2a096252f6b642113307201fd6b04/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 07:06:17,784 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/namespace/cbb2a096252f6b642113307201fd6b04 2023-07-22 07:06:17,785 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/namespace/cbb2a096252f6b642113307201fd6b04 2023-07-22 07:06:17,790 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cbb2a096252f6b642113307201fd6b04 2023-07-22 07:06:17,793 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/namespace/cbb2a096252f6b642113307201fd6b04/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 07:06:17,794 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cbb2a096252f6b642113307201fd6b04; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60839711, jitterRate=-0.09341765940189362}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 07:06:17,794 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cbb2a096252f6b642113307201fd6b04: 2023-07-22 07:06:17,799 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1690009577208.cbb2a096252f6b642113307201fd6b04., pid=6, masterSystemTime=1690009577756 2023-07-22 07:06:17,808 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1690009577208.cbb2a096252f6b642113307201fd6b04. 2023-07-22 07:06:17,808 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1690009577208.cbb2a096252f6b642113307201fd6b04. 2023-07-22 07:06:17,812 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=cbb2a096252f6b642113307201fd6b04, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:17,812 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1690009577208.cbb2a096252f6b642113307201fd6b04.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690009577811"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690009577811"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690009577811"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690009577811"}]},"ts":"1690009577811"} 2023-07-22 07:06:17,821 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-22 07:06:17,821 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure cbb2a096252f6b642113307201fd6b04, server=jenkins-hbase4.apache.org,43271,1690009574333 in 216 msec 2023-07-22 07:06:17,826 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-22 07:06:17,827 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=cbb2a096252f6b642113307201fd6b04, ASSIGN in 383 msec 2023-07-22 07:06:17,828 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 07:06:17,828 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690009577828"}]},"ts":"1690009577828"} 2023-07-22 07:06:17,831 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-22 07:06:17,834 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 07:06:17,839 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 624 msec 2023-07-22 07:06:17,927 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-22 07:06:17,930 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-22 07:06:17,930 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 07:06:17,975 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-22 07:06:18,000 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-22 07:06:18,008 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 43 msec 2023-07-22 07:06:18,020 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-22 07:06:18,034 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-22 07:06:18,040 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 19 msec 2023-07-22 07:06:18,047 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-22 07:06:18,049 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-22 07:06:18,049 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.604sec 2023-07-22 07:06:18,053 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-22 07:06:18,054 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-22 07:06:18,054 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-22 07:06:18,056 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44609,1690009572558-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-22 07:06:18,057 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44609,1690009572558-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-22 07:06:18,078 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-22 07:06:18,080 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-22 07:06:18,083 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 07:06:18,084 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 07:06:18,087 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/hbase/acl/ffac00db7cc9550566202da8d7404f2e 2023-07-22 07:06:18,088 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/hbase/acl/ffac00db7cc9550566202da8d7404f2e empty. 2023-07-22 07:06:18,091 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/hbase/acl/ffac00db7cc9550566202da8d7404f2e 2023-07-22 07:06:18,091 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-22 07:06:18,091 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-22 07:06:18,098 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-22 07:06:18,105 DEBUG [Listener at localhost/45423] zookeeper.ReadOnlyZKClient(139): Connect 0x683dee07 to 127.0.0.1:63277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 07:06:18,117 DEBUG [Listener at localhost/45423] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e1990f9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 07:06:18,119 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-22 07:06:18,122 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => ffac00db7cc9550566202da8d7404f2e, NAME => 'hbase:acl,,1690009578074.ffac00db7cc9550566202da8d7404f2e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp 2023-07-22 07:06:18,139 DEBUG [hconnection-0x430a1db4-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 07:06:18,164 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59606, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 07:06:18,167 INFO [Listener at localhost/45423] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,44609,1690009572558 2023-07-22 07:06:18,167 INFO [Listener at localhost/45423] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-22 07:06:18,167 INFO [Listener at localhost/45423] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/test.cache.data in system properties and HBase conf 2023-07-22 07:06:18,168 INFO [Listener at localhost/45423] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/hadoop.tmp.dir in system properties and HBase conf 2023-07-22 07:06:18,168 INFO [Listener at localhost/45423] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/hadoop.log.dir in system properties and HBase conf 2023-07-22 07:06:18,168 INFO [Listener at localhost/45423] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-22 07:06:18,168 INFO [Listener at localhost/45423] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-22 07:06:18,168 INFO [Listener at localhost/45423] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-22 07:06:18,168 INFO [Listener at localhost/45423] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-22 07:06:18,168 INFO [Listener at localhost/45423] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-22 07:06:18,169 INFO [Listener at localhost/45423] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-22 07:06:18,169 INFO [Listener at localhost/45423] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-22 07:06:18,169 INFO [Listener at localhost/45423] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-22 07:06:18,169 INFO [Listener at localhost/45423] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-22 07:06:18,169 INFO [Listener at localhost/45423] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-22 07:06:18,169 INFO [Listener at localhost/45423] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-22 07:06:18,169 INFO [Listener at localhost/45423] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-22 07:06:18,169 INFO [Listener at localhost/45423] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/nfs.dump.dir in system properties and HBase conf 2023-07-22 07:06:18,170 INFO [Listener at localhost/45423] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/java.io.tmpdir in system properties and HBase conf 2023-07-22 07:06:18,170 INFO [Listener at localhost/45423] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-22 07:06:18,170 INFO [Listener at localhost/45423] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-22 07:06:18,170 INFO [Listener at localhost/45423] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-22 07:06:18,179 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690009578074.ffac00db7cc9550566202da8d7404f2e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 07:06:18,179 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing ffac00db7cc9550566202da8d7404f2e, disabling compactions & flushes 2023-07-22 07:06:18,179 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690009578074.ffac00db7cc9550566202da8d7404f2e. 2023-07-22 07:06:18,179 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690009578074.ffac00db7cc9550566202da8d7404f2e. 2023-07-22 07:06:18,179 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690009578074.ffac00db7cc9550566202da8d7404f2e. after waiting 0 ms 2023-07-22 07:06:18,179 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690009578074.ffac00db7cc9550566202da8d7404f2e. 2023-07-22 07:06:18,179 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1690009578074.ffac00db7cc9550566202da8d7404f2e. 2023-07-22 07:06:18,179 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for ffac00db7cc9550566202da8d7404f2e: 2023-07-22 07:06:18,185 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 07:06:18,188 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1690009578074.ffac00db7cc9550566202da8d7404f2e.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690009578188"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690009578188"}]},"ts":"1690009578188"} 2023-07-22 07:06:18,198 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-22 07:06:18,200 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 07:06:18,201 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690009578200"}]},"ts":"1690009578200"} 2023-07-22 07:06:18,202 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-22 07:06:18,203 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-22 07:06:18,208 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 07:06:18,209 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 07:06:18,209 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 07:06:18,209 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 07:06:18,209 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 07:06:18,209 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=ffac00db7cc9550566202da8d7404f2e, ASSIGN}] 2023-07-22 07:06:18,212 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=ffac00db7cc9550566202da8d7404f2e, ASSIGN 2023-07-22 07:06:18,214 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=ffac00db7cc9550566202da8d7404f2e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44269,1690009574260; forceNewPlan=false, retain=false 2023-07-22 07:06:18,364 INFO [jenkins-hbase4:44609] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-22 07:06:18,366 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=ffac00db7cc9550566202da8d7404f2e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:18,366 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1690009578074.ffac00db7cc9550566202da8d7404f2e.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690009578365"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690009578365"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690009578365"}]},"ts":"1690009578365"} 2023-07-22 07:06:18,370 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure ffac00db7cc9550566202da8d7404f2e, server=jenkins-hbase4.apache.org,44269,1690009574260}] 2023-07-22 07:06:18,403 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-22 07:06:18,527 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:18,528 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-22 07:06:18,535 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40358, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-22 07:06:18,543 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1690009578074.ffac00db7cc9550566202da8d7404f2e. 2023-07-22 07:06:18,544 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ffac00db7cc9550566202da8d7404f2e, NAME => 'hbase:acl,,1690009578074.ffac00db7cc9550566202da8d7404f2e.', STARTKEY => '', ENDKEY => ''} 2023-07-22 07:06:18,544 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1690009578074.ffac00db7cc9550566202da8d7404f2e. service=AccessControlService 2023-07-22 07:06:18,544 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 07:06:18,545 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl ffac00db7cc9550566202da8d7404f2e 2023-07-22 07:06:18,545 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690009578074.ffac00db7cc9550566202da8d7404f2e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 07:06:18,545 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ffac00db7cc9550566202da8d7404f2e 2023-07-22 07:06:18,545 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ffac00db7cc9550566202da8d7404f2e 2023-07-22 07:06:18,551 INFO [StoreOpener-ffac00db7cc9550566202da8d7404f2e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region ffac00db7cc9550566202da8d7404f2e 2023-07-22 07:06:18,554 DEBUG [StoreOpener-ffac00db7cc9550566202da8d7404f2e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/acl/ffac00db7cc9550566202da8d7404f2e/l 2023-07-22 07:06:18,554 DEBUG [StoreOpener-ffac00db7cc9550566202da8d7404f2e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/acl/ffac00db7cc9550566202da8d7404f2e/l 2023-07-22 07:06:18,555 INFO [StoreOpener-ffac00db7cc9550566202da8d7404f2e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ffac00db7cc9550566202da8d7404f2e columnFamilyName l 2023-07-22 07:06:18,556 INFO [StoreOpener-ffac00db7cc9550566202da8d7404f2e-1] regionserver.HStore(310): Store=ffac00db7cc9550566202da8d7404f2e/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 07:06:18,558 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/acl/ffac00db7cc9550566202da8d7404f2e 2023-07-22 07:06:18,560 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/acl/ffac00db7cc9550566202da8d7404f2e 2023-07-22 07:06:18,568 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ffac00db7cc9550566202da8d7404f2e 2023-07-22 07:06:18,574 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/acl/ffac00db7cc9550566202da8d7404f2e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 07:06:18,576 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ffac00db7cc9550566202da8d7404f2e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68243450, jitterRate=0.016906648874282837}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 07:06:18,576 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ffac00db7cc9550566202da8d7404f2e: 2023-07-22 07:06:18,580 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1690009578074.ffac00db7cc9550566202da8d7404f2e., pid=11, masterSystemTime=1690009578527 2023-07-22 07:06:18,586 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1690009578074.ffac00db7cc9550566202da8d7404f2e. 2023-07-22 07:06:18,587 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1690009578074.ffac00db7cc9550566202da8d7404f2e. 2023-07-22 07:06:18,588 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=ffac00db7cc9550566202da8d7404f2e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:18,588 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1690009578074.ffac00db7cc9550566202da8d7404f2e.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690009578588"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690009578588"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690009578588"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690009578588"}]},"ts":"1690009578588"} 2023-07-22 07:06:18,596 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-22 07:06:18,596 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure ffac00db7cc9550566202da8d7404f2e, server=jenkins-hbase4.apache.org,44269,1690009574260 in 222 msec 2023-07-22 07:06:18,604 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-22 07:06:18,604 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=ffac00db7cc9550566202da8d7404f2e, ASSIGN in 387 msec 2023-07-22 07:06:18,606 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 07:06:18,607 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690009578607"}]},"ts":"1690009578607"} 2023-07-22 07:06:18,612 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-22 07:06:18,617 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 07:06:18,620 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 538 msec 2023-07-22 07:06:18,703 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-22 07:06:18,703 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-22 07:06:18,717 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-22 07:06:19,470 WARN [Thread-385] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 07:06:19,777 INFO [Thread-385] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 07:06:19,787 INFO [Thread-385] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_42843_jobhistory____reshk2/webapp 2023-07-22 07:06:19,944 INFO [Thread-385] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-22 07:06:19,944 INFO [Thread-385] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-22 07:06:19,944 INFO [Thread-385] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-22 07:06:19,947 INFO [Thread-385] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-22 07:06:20,025 INFO [Thread-385] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 07:06:20,371 INFO [Thread-385] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 07:06:20,743 INFO [Thread-385] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-22 07:06:20,831 INFO [Thread-385] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:42843 2023-07-22 07:06:20,966 WARN [Listener at jenkins-hbase4.apache.org/41613] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 07:06:21,428 WARN [Listener at jenkins-hbase4.apache.org/41613] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-22 07:06:21,431 INFO [Listener at jenkins-hbase4.apache.org/41613] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 07:06:21,446 INFO [Listener at jenkins-hbase4.apache.org/41613] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34003_cluster____adzxv6/webapp 2023-07-22 07:06:21,535 INFO [Listener at jenkins-hbase4.apache.org/41613] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-22 07:06:21,536 INFO [Listener at jenkins-hbase4.apache.org/41613] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-22 07:06:21,536 INFO [Listener at jenkins-hbase4.apache.org/41613] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-22 07:06:21,536 INFO [Listener at jenkins-hbase4.apache.org/41613] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-22 07:06:21,548 INFO [Listener at jenkins-hbase4.apache.org/41613] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 07:06:21,829 INFO [Listener at jenkins-hbase4.apache.org/41613] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 07:06:22,081 INFO [Listener at jenkins-hbase4.apache.org/41613] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 07:06:22,092 INFO [Listener at jenkins-hbase4.apache.org/41613] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34003 2023-07-22 07:06:22,515 WARN [Listener at jenkins-hbase4.apache.org/46175] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 07:06:22,543 WARN [Listener at jenkins-hbase4.apache.org/46175] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-22 07:06:22,544 INFO [Listener at jenkins-hbase4.apache.org/46175] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 07:06:22,551 INFO [Listener at jenkins-hbase4.apache.org/46175] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_43615_node____6crtx5/webapp 2023-07-22 07:06:22,580 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 07:06:22,646 INFO [Listener at jenkins-hbase4.apache.org/46175] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-22 07:06:22,647 INFO [Listener at jenkins-hbase4.apache.org/46175] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-22 07:06:22,647 INFO [Listener at jenkins-hbase4.apache.org/46175] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-22 07:06:22,647 INFO [Listener at jenkins-hbase4.apache.org/46175] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-22 07:06:22,659 INFO [Listener at jenkins-hbase4.apache.org/46175] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 07:06:22,701 INFO [Listener at jenkins-hbase4.apache.org/46175] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 07:06:22,794 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-22 07:06:22,795 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-22 07:06:22,797 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-22 07:06:22,798 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 07:06:22,799 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-22 07:06:22,799 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 07:06:22,799 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-22 07:06:22,799 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-22 07:06:22,799 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-22 07:06:22,800 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 07:06:22,800 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-22 07:06:22,800 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-22 07:06:22,800 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-22 07:06:22,856 INFO [Listener at jenkins-hbase4.apache.org/46175] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 07:06:22,872 INFO [Listener at jenkins-hbase4.apache.org/46175] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:43615 2023-07-22 07:06:23,174 WARN [Listener at jenkins-hbase4.apache.org/45401] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 07:06:23,182 WARN [Listener at jenkins-hbase4.apache.org/45401] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-22 07:06:23,183 INFO [Listener at jenkins-hbase4.apache.org/45401] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 07:06:23,190 INFO [Listener at jenkins-hbase4.apache.org/45401] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_46553_node____i8axhr/webapp 2023-07-22 07:06:23,267 INFO [Listener at jenkins-hbase4.apache.org/45401] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-22 07:06:23,267 INFO [Listener at jenkins-hbase4.apache.org/45401] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-22 07:06:23,267 INFO [Listener at jenkins-hbase4.apache.org/45401] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-22 07:06:23,268 INFO [Listener at jenkins-hbase4.apache.org/45401] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-22 07:06:23,283 INFO [Listener at jenkins-hbase4.apache.org/45401] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 07:06:23,309 INFO [Listener at jenkins-hbase4.apache.org/45401] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 07:06:23,411 INFO [Listener at jenkins-hbase4.apache.org/45401] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 07:06:23,424 INFO [Listener at jenkins-hbase4.apache.org/45401] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46553 2023-07-22 07:06:23,459 INFO [Listener at jenkins-hbase4.apache.org/45401] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-22 07:06:23,460 INFO [Listener at jenkins-hbase4.apache.org/45401] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 07:06:23,535 INFO [Listener at jenkins-hbase4.apache.org/45401] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=704, OpenFileDescriptor=901, MaxFileDescriptor=60000, SystemLoadAverage=322, ProcessCount=173, AvailableMemoryMB=8553 2023-07-22 07:06:23,535 WARN [Listener at jenkins-hbase4.apache.org/45401] hbase.ResourceChecker(130): Thread=704 is superior to 500 2023-07-22 07:06:23,554 DEBUG [Listener at jenkins-hbase4.apache.org/45401] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-22 07:06:23,562 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48902, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-22 07:06:23,569 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-22 07:06:23,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-22 07:06:23,577 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 07:06:23,578 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-22 07:06:23,580 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 07:06:23,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-22 07:06:23,595 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportWithTargetName/76744faeabda2e1fb4144cfb9d7cfbc8 2023-07-22 07:06:23,597 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportWithTargetName/76744faeabda2e1fb4144cfb9d7cfbc8 empty. 2023-07-22 07:06:23,597 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportWithTargetName/fd702076a4a34554b12353062b4e614f 2023-07-22 07:06:23,599 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportWithTargetName/76744faeabda2e1fb4144cfb9d7cfbc8 2023-07-22 07:06:23,600 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportWithTargetName/fd702076a4a34554b12353062b4e614f empty. 2023-07-22 07:06:23,602 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportWithTargetName/fd702076a4a34554b12353062b4e614f 2023-07-22 07:06:23,602 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-22 07:06:23,645 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-22 07:06:23,655 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 76744faeabda2e1fb4144cfb9d7cfbc8, NAME => 'testtb-testExportWithTargetName,,1690009583569.76744faeabda2e1fb4144cfb9d7cfbc8.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp 2023-07-22 07:06:23,659 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => fd702076a4a34554b12353062b4e614f, NAME => 'testtb-testExportWithTargetName,1,1690009583569.fd702076a4a34554b12353062b4e614f.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp 2023-07-22 07:06:23,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-22 07:06:23,723 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1690009583569.fd702076a4a34554b12353062b4e614f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 07:06:23,724 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing fd702076a4a34554b12353062b4e614f, disabling compactions & flushes 2023-07-22 07:06:23,724 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1690009583569.fd702076a4a34554b12353062b4e614f. 2023-07-22 07:06:23,724 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1690009583569.fd702076a4a34554b12353062b4e614f. 2023-07-22 07:06:23,724 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1690009583569.fd702076a4a34554b12353062b4e614f. after waiting 0 ms 2023-07-22 07:06:23,724 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1690009583569.fd702076a4a34554b12353062b4e614f. 2023-07-22 07:06:23,724 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1690009583569.fd702076a4a34554b12353062b4e614f. 2023-07-22 07:06:23,724 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for fd702076a4a34554b12353062b4e614f: 2023-07-22 07:06:23,726 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1690009583569.76744faeabda2e1fb4144cfb9d7cfbc8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 07:06:23,726 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 76744faeabda2e1fb4144cfb9d7cfbc8, disabling compactions & flushes 2023-07-22 07:06:23,726 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1690009583569.76744faeabda2e1fb4144cfb9d7cfbc8. 2023-07-22 07:06:23,726 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1690009583569.76744faeabda2e1fb4144cfb9d7cfbc8. 2023-07-22 07:06:23,726 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1690009583569.76744faeabda2e1fb4144cfb9d7cfbc8. after waiting 0 ms 2023-07-22 07:06:23,726 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1690009583569.76744faeabda2e1fb4144cfb9d7cfbc8. 2023-07-22 07:06:23,726 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1690009583569.76744faeabda2e1fb4144cfb9d7cfbc8. 2023-07-22 07:06:23,726 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 76744faeabda2e1fb4144cfb9d7cfbc8: 2023-07-22 07:06:23,731 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 07:06:23,733 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1690009583569.fd702076a4a34554b12353062b4e614f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690009583732"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690009583732"}]},"ts":"1690009583732"} 2023-07-22 07:06:23,733 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1690009583569.76744faeabda2e1fb4144cfb9d7cfbc8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690009583732"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690009583732"}]},"ts":"1690009583732"} 2023-07-22 07:06:23,781 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-22 07:06:23,782 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 07:06:23,782 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690009583782"}]},"ts":"1690009583782"} 2023-07-22 07:06:23,784 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-22 07:06:23,789 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 07:06:23,792 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 07:06:23,792 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 07:06:23,792 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 07:06:23,792 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 07:06:23,792 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=76744faeabda2e1fb4144cfb9d7cfbc8, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fd702076a4a34554b12353062b4e614f, ASSIGN}] 2023-07-22 07:06:23,795 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fd702076a4a34554b12353062b4e614f, ASSIGN 2023-07-22 07:06:23,795 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=76744faeabda2e1fb4144cfb9d7cfbc8, ASSIGN 2023-07-22 07:06:23,797 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fd702076a4a34554b12353062b4e614f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34707,1690009574173; forceNewPlan=false, retain=false 2023-07-22 07:06:23,797 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=76744faeabda2e1fb4144cfb9d7cfbc8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43271,1690009574333; forceNewPlan=false, retain=false 2023-07-22 07:06:23,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-22 07:06:23,947 INFO [jenkins-hbase4:44609] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-22 07:06:23,949 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=76744faeabda2e1fb4144cfb9d7cfbc8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:23,949 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=fd702076a4a34554b12353062b4e614f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:23,949 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1690009583569.76744faeabda2e1fb4144cfb9d7cfbc8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690009583949"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690009583949"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690009583949"}]},"ts":"1690009583949"} 2023-07-22 07:06:23,949 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1690009583569.fd702076a4a34554b12353062b4e614f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690009583949"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690009583949"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690009583949"}]},"ts":"1690009583949"} 2023-07-22 07:06:23,953 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure fd702076a4a34554b12353062b4e614f, server=jenkins-hbase4.apache.org,34707,1690009574173}] 2023-07-22 07:06:23,954 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 76744faeabda2e1fb4144cfb9d7cfbc8, server=jenkins-hbase4.apache.org,43271,1690009574333}] 2023-07-22 07:06:24,107 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:24,107 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-22 07:06:24,120 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38200, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-22 07:06:24,122 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1690009583569.76744faeabda2e1fb4144cfb9d7cfbc8. 2023-07-22 07:06:24,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 76744faeabda2e1fb4144cfb9d7cfbc8, NAME => 'testtb-testExportWithTargetName,,1690009583569.76744faeabda2e1fb4144cfb9d7cfbc8.', STARTKEY => '', ENDKEY => '1'} 2023-07-22 07:06:24,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1690009583569.76744faeabda2e1fb4144cfb9d7cfbc8. service=AccessControlService 2023-07-22 07:06:24,123 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 07:06:24,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 76744faeabda2e1fb4144cfb9d7cfbc8 2023-07-22 07:06:24,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1690009583569.76744faeabda2e1fb4144cfb9d7cfbc8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 07:06:24,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 76744faeabda2e1fb4144cfb9d7cfbc8 2023-07-22 07:06:24,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 76744faeabda2e1fb4144cfb9d7cfbc8 2023-07-22 07:06:24,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1690009583569.fd702076a4a34554b12353062b4e614f. 2023-07-22 07:06:24,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fd702076a4a34554b12353062b4e614f, NAME => 'testtb-testExportWithTargetName,1,1690009583569.fd702076a4a34554b12353062b4e614f.', STARTKEY => '1', ENDKEY => ''} 2023-07-22 07:06:24,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1690009583569.fd702076a4a34554b12353062b4e614f. service=AccessControlService 2023-07-22 07:06:24,131 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 07:06:24,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName fd702076a4a34554b12353062b4e614f 2023-07-22 07:06:24,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1690009583569.fd702076a4a34554b12353062b4e614f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 07:06:24,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fd702076a4a34554b12353062b4e614f 2023-07-22 07:06:24,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fd702076a4a34554b12353062b4e614f 2023-07-22 07:06:24,136 INFO [StoreOpener-76744faeabda2e1fb4144cfb9d7cfbc8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 76744faeabda2e1fb4144cfb9d7cfbc8 2023-07-22 07:06:24,139 INFO [StoreOpener-fd702076a4a34554b12353062b4e614f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fd702076a4a34554b12353062b4e614f 2023-07-22 07:06:24,140 DEBUG [StoreOpener-76744faeabda2e1fb4144cfb9d7cfbc8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportWithTargetName/76744faeabda2e1fb4144cfb9d7cfbc8/cf 2023-07-22 07:06:24,140 DEBUG [StoreOpener-76744faeabda2e1fb4144cfb9d7cfbc8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportWithTargetName/76744faeabda2e1fb4144cfb9d7cfbc8/cf 2023-07-22 07:06:24,141 DEBUG [StoreOpener-fd702076a4a34554b12353062b4e614f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportWithTargetName/fd702076a4a34554b12353062b4e614f/cf 2023-07-22 07:06:24,141 DEBUG [StoreOpener-fd702076a4a34554b12353062b4e614f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportWithTargetName/fd702076a4a34554b12353062b4e614f/cf 2023-07-22 07:06:24,145 INFO [StoreOpener-76744faeabda2e1fb4144cfb9d7cfbc8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 76744faeabda2e1fb4144cfb9d7cfbc8 columnFamilyName cf 2023-07-22 07:06:24,145 INFO [StoreOpener-fd702076a4a34554b12353062b4e614f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fd702076a4a34554b12353062b4e614f columnFamilyName cf 2023-07-22 07:06:24,148 INFO [StoreOpener-fd702076a4a34554b12353062b4e614f-1] regionserver.HStore(310): Store=fd702076a4a34554b12353062b4e614f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 07:06:24,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportWithTargetName/fd702076a4a34554b12353062b4e614f 2023-07-22 07:06:24,152 INFO [StoreOpener-76744faeabda2e1fb4144cfb9d7cfbc8-1] regionserver.HStore(310): Store=76744faeabda2e1fb4144cfb9d7cfbc8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 07:06:24,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportWithTargetName/76744faeabda2e1fb4144cfb9d7cfbc8 2023-07-22 07:06:24,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportWithTargetName/76744faeabda2e1fb4144cfb9d7cfbc8 2023-07-22 07:06:24,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportWithTargetName/fd702076a4a34554b12353062b4e614f 2023-07-22 07:06:24,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 76744faeabda2e1fb4144cfb9d7cfbc8 2023-07-22 07:06:24,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fd702076a4a34554b12353062b4e614f 2023-07-22 07:06:24,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportWithTargetName/76744faeabda2e1fb4144cfb9d7cfbc8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 07:06:24,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-22 07:06:24,190 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 76744faeabda2e1fb4144cfb9d7cfbc8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74677688, jitterRate=0.11278426647186279}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 07:06:24,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 76744faeabda2e1fb4144cfb9d7cfbc8: 2023-07-22 07:06:24,192 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1690009583569.76744faeabda2e1fb4144cfb9d7cfbc8., pid=16, masterSystemTime=1690009584107 2023-07-22 07:06:24,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1690009583569.76744faeabda2e1fb4144cfb9d7cfbc8. 2023-07-22 07:06:24,199 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=76744faeabda2e1fb4144cfb9d7cfbc8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:24,199 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1690009583569.76744faeabda2e1fb4144cfb9d7cfbc8. 2023-07-22 07:06:24,199 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1690009583569.76744faeabda2e1fb4144cfb9d7cfbc8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690009584198"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690009584198"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690009584198"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690009584198"}]},"ts":"1690009584198"} 2023-07-22 07:06:24,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportWithTargetName/fd702076a4a34554b12353062b4e614f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 07:06:24,201 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fd702076a4a34554b12353062b4e614f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74857440, jitterRate=0.1154627799987793}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 07:06:24,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fd702076a4a34554b12353062b4e614f: 2023-07-22 07:06:24,205 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1690009583569.fd702076a4a34554b12353062b4e614f., pid=15, masterSystemTime=1690009584107 2023-07-22 07:06:24,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1690009583569.fd702076a4a34554b12353062b4e614f. 2023-07-22 07:06:24,213 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1690009583569.fd702076a4a34554b12353062b4e614f. 2023-07-22 07:06:24,214 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=fd702076a4a34554b12353062b4e614f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:24,216 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1690009583569.fd702076a4a34554b12353062b4e614f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690009584214"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690009584214"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690009584214"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690009584214"}]},"ts":"1690009584214"} 2023-07-22 07:06:24,216 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-22 07:06:24,217 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 76744faeabda2e1fb4144cfb9d7cfbc8, server=jenkins-hbase4.apache.org,43271,1690009574333 in 251 msec 2023-07-22 07:06:24,220 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=76744faeabda2e1fb4144cfb9d7cfbc8, ASSIGN in 424 msec 2023-07-22 07:06:24,228 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-22 07:06:24,231 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure fd702076a4a34554b12353062b4e614f, server=jenkins-hbase4.apache.org,34707,1690009574173 in 267 msec 2023-07-22 07:06:24,235 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=12 2023-07-22 07:06:24,235 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fd702076a4a34554b12353062b4e614f, ASSIGN in 436 msec 2023-07-22 07:06:24,237 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 07:06:24,237 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690009584237"}]},"ts":"1690009584237"} 2023-07-22 07:06:24,239 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-22 07:06:24,243 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 07:06:24,249 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-22 07:06:24,257 DEBUG [PEWorker-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 07:06:24,262 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56394, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 07:06:24,267 DEBUG [hconnection-0x61cb458d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 07:06:24,271 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45206, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2023-07-22 07:06:24,283 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44269] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-22 07:06:24,325 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-22 07:06:24,325 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-22 07:06:24,325 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-22 07:06:24,325 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-22 07:06:24,325 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 07:06:24,333 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-22 07:06:24,333 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-22 07:06:24,334 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-22 07:06:24,334 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-22 07:06:24,337 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 764 msec 2023-07-22 07:06:24,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-22 07:06:24,692 INFO [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-22 07:06:24,696 DEBUG [Listener at jenkins-hbase4.apache.org/45401] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-22 07:06:24,698 DEBUG [Listener at jenkins-hbase4.apache.org/45401] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1690009583569.76744faeabda2e1fb4144cfb9d7cfbc8. 2023-07-22 07:06:24,701 INFO [Listener at jenkins-hbase4.apache.org/45401] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 07:06:24,731 DEBUG [hconnection-0x430a1db4-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 07:06:24,736 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38216, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 07:06:24,761 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-22 07:06:24,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690009584761 (current time:1690009584761). 2023-07-22 07:06:24,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 07:06:24,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(139): Connect 0x1ac2ac38 to 127.0.0.1:63277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 07:06:24,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6475dc3e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 07:06:24,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 07:06:24,784 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45214, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 07:06:24,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1ac2ac38 to 127.0.0.1:63277 2023-07-22 07:06:24,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 07:06:24,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(139): Connect 0x0910116d to 127.0.0.1:63277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 07:06:24,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e05a8b0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 07:06:24,810 DEBUG [hconnection-0x36d40443-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 07:06:24,815 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45218, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 07:06:24,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 07:06:24,821 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56396, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 07:06:24,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0910116d to 127.0.0.1:63277 2023-07-22 07:06:24,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 07:06:24,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-22 07:06:24,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 07:06:24,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-22 07:06:24,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-22 07:06:24,884 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-22 07:06:24,886 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1690010184886 2023-07-22 07:06:24,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-22 07:06:24,891 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-22 07:06:24,894 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-22 07:06:24,899 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-22 07:06:24,901 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 07:06:24,901 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 07:06:24,905 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 22 msec 2023-07-22 07:06:24,907 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-22 07:06:24,908 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1690010184908 2023-07-22 07:06:24,968 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:24,968 INFO [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-22 07:06:24,968 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:06:24,969 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-22 07:06:24,969 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-22 07:06:24,970 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:24,970 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:24,975 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:06:24,976 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:24,975 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:06:24,975 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:06:24,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:06:24,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:06:24,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:06:24,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:06:24,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:06:24,976 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:24,976 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:24,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:06:24,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:24,977 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:24,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:24,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:24,977 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 07:06:24,977 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:24,977 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:24,977 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:24,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-22 07:06:24,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:24,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-22 07:06:24,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:24,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-22 07:06:24,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:24,978 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-22 07:06:24,979 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-22 07:06:24,978 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-22 07:06:24,982 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:24,987 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:24,988 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:24,988 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-22 07:06:24,988 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:06:24,988 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-22 07:06:24,988 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:06:24,990 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-22 07:06:24,990 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-22 07:06:24,990 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-22 07:06:24,990 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-22 07:06:24,990 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34707,1690009574173' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-22 07:06:24,990 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:06:24,990 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-22 07:06:24,991 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43271,1690009574333' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-22 07:06:24,991 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-22 07:06:24,992 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-22 07:06:24,992 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44269,1690009574260' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-22 07:06:24,994 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:24,994 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:24,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:24,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:06:24,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:06:24,997 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:24,997 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:24,997 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:24,997 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 07:06:24,997 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:24,997 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:24,997 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 07:06:24,998 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:24,998 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 07:06:24,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:06:24,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:06:24,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:24,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:25,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:25,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:25,001 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 07:06:25,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:06:25,002 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34707,1690009574173' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-22 07:06:25,002 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@148c411b[Count = 1] remaining members to acquire global barrier 2023-07-22 07:06:25,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:25,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:06:25,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:06:25,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:06:25,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:06:25,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-22 07:06:25,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:25,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:25,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:25,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:06:25,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-22 07:06:25,006 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43271,1690009574333' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-22 07:06:25,006 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@148c411b[Count = 0] remaining members to acquire global barrier 2023-07-22 07:06:25,006 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-22 07:06:25,007 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,007 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 07:06:25,014 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,014 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,014 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,014 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-22 07:06:25,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,015 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-22 07:06:25,016 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-22 07:06:25,016 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-22 07:06:25,016 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44269,1690009574260' in zk 2023-07-22 07:06:25,016 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 07:06:25,016 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1690009583569.fd702076a4a34554b12353062b4e614f. 2023-07-22 07:06:25,016 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 07:06:25,016 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:25,016 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 07:06:25,017 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 07:06:25,016 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1690009583569.76744faeabda2e1fb4144cfb9d7cfbc8. 2023-07-22 07:06:25,017 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1690009583569.76744faeabda2e1fb4144cfb9d7cfbc8. started... 2023-07-22 07:06:25,017 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1690009583569.fd702076a4a34554b12353062b4e614f. started... 2023-07-22 07:06:25,017 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:25,017 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 07:06:25,023 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-22 07:06:25,023 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:06:25,023 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-22 07:06:25,023 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 76744faeabda2e1fb4144cfb9d7cfbc8: 2023-07-22 07:06:25,023 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fd702076a4a34554b12353062b4e614f: 2023-07-22 07:06:25,024 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1690009583569.76744faeabda2e1fb4144cfb9d7cfbc8.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,024 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1690009583569.fd702076a4a34554b12353062b4e614f.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,032 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 07:06:25,032 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 07:06:25,037 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 07:06:25,037 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 07:06:25,077 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1690009583569.fd702076a4a34554b12353062b4e614f. completed. 2023-07-22 07:06:25,077 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1690009583569.fd702076a4a34554b12353062b4e614f. 2023-07-22 07:06:25,077 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 07:06:25,077 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 07:06:25,077 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:25,078 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-22 07:06:25,078 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34707,1690009574173' in zk 2023-07-22 07:06:25,083 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:25,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:25,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:06:25,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:06:25,083 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-22 07:06:25,084 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:06:25,084 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-22 07:06:25,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:06:25,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:06:25,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:25,087 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1690009583569.76744faeabda2e1fb4144cfb9d7cfbc8. completed. 2023-07-22 07:06:25,087 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1690009583569.76744faeabda2e1fb4144cfb9d7cfbc8. 2023-07-22 07:06:25,087 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 07:06:25,087 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 07:06:25,087 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:25,088 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-22 07:06:25,088 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43271,1690009574333' in zk 2023-07-22 07:06:25,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:25,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:25,090 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-22 07:06:25,090 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:06:25,090 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:25,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:06:25,090 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-22 07:06:25,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:25,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:25,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:25,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,34707,1690009574173': 2023-07-22 07:06:25,095 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34707,1690009574173' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-22 07:06:25,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:25,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:06:25,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:06:25,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:06:25,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:06:25,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:25,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:25,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:25,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:06:25,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:25,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:25,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:25,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43271,1690009574333': 2023-07-22 07:06:25,102 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43271,1690009574333' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-22 07:06:25,102 INFO [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-22 07:06:25,102 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 07:06:25,102 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 07:06:25,102 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,102 INFO [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 07:06:25,105 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,105 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:06:25,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:06:25,105 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,105 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,105 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:06:25,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,105 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:06:25,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,105 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:06:25,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:06:25,106 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:25,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:06:25,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:06:25,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:06:25,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:06:25,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:06:25,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:06:25,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,107 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:25,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:06:25,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,107 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:25,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:25,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:25,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:25,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:06:25,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,110 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:25,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:25,110 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:25,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:25,110 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:25,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:25,123 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:25,123 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,123 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:25,124 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:06:25,124 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:06:25,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:06:25,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:06:25,124 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:06:25,124 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:06:25,124 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:06:25,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:06:25,124 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:06:25,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:06:25,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:06:25,124 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:25,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:06:25,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:06:25,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:06:25,125 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,126 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-22 07:06:25,126 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,126 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-22 07:06:25,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:06:25,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:06:25,124 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:06:25,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:06:25,125 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:06:25,126 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:25,127 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,127 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:25,128 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:25,128 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,128 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,128 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-22 07:06:25,156 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,159 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,207 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,207 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 07:06:25,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-22 07:06:25,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-22 07:06:25,209 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-22 07:06:25,243 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-22 07:06:25,243 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,244 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:25,244 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1690009584891Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1690009585156 (+265 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1690009585156Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1690009585156Writing data manifest for emptySnaptb0-testExportWithTargetName at 1690009585171 (+15 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1690009585196 (+25 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1690009585243 (+47 ms) 2023-07-22 07:06:25,246 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-22 07:06:25,249 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 349 msec 2023-07-22 07:06:25,509 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 07:06:25,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-22 07:06:25,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 07:06:25,530 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43271] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1690009583569.76744faeabda2e1fb4144cfb9d7cfbc8. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 07:06:25,533 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34707] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1690009583569.fd702076a4a34554b12353062b4e614f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 07:06:25,539 DEBUG [Listener at jenkins-hbase4.apache.org/45401] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-22 07:06:25,539 DEBUG [Listener at jenkins-hbase4.apache.org/45401] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1690009583569.76744faeabda2e1fb4144cfb9d7cfbc8. 2023-07-22 07:06:25,539 INFO [Listener at jenkins-hbase4.apache.org/45401] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 07:06:25,557 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-22 07:06:25,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690009585557 (current time:1690009585557). 2023-07-22 07:06:25,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 07:06:25,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(139): Connect 0x69347da3 to 127.0.0.1:63277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 07:06:25,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a6efe75, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 07:06:25,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 07:06:25,571 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45228, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 07:06:25,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x69347da3 to 127.0.0.1:63277 2023-07-22 07:06:25,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 07:06:25,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(139): Connect 0x65d6dc9e to 127.0.0.1:63277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 07:06:25,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f456ce2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 07:06:25,583 DEBUG [hconnection-0x32c5a229-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 07:06:25,586 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45238, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 07:06:25,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 07:06:25,595 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56406, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 07:06:25,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x65d6dc9e to 127.0.0.1:63277 2023-07-22 07:06:25,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 07:06:25,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-22 07:06:25,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 07:06:25,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-22 07:06:25,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-22 07:06:25,605 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-22 07:06:25,606 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1690010185606 2023-07-22 07:06:25,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-22 07:06:25,607 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-22 07:06:25,609 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 07:06:25,609 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 07:06:25,610 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-22 07:06:25,611 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-22 07:06:25,614 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 10 msec 2023-07-22 07:06:25,615 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-22 07:06:25,616 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1690010185616 2023-07-22 07:06:25,635 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-22 07:06:25,635 INFO [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-22 07:06:25,635 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:06:25,636 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-22 07:06:25,637 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-22 07:06:25,703 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 07:06:25,703 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 07:06:25,704 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:06:25,704 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:06:25,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:06:25,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:06:25,704 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:25,704 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:06:25,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:06:25,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:06:25,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:06:25,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:06:25,705 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:25,705 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:25,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 07:06:25,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 07:06:25,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 07:06:25,706 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 07:06:25,706 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 07:06:25,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-22 07:06:25,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 07:06:25,707 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:25,707 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 07:06:25,707 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-22 07:06:25,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-22 07:06:25,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 07:06:25,707 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 07:06:25,707 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-22 07:06:25,707 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-22 07:06:25,707 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-22 07:06:25,707 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:06:25,707 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-22 07:06:25,709 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-22 07:06:25,709 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-22 07:06:25,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-22 07:06:25,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 07:06:25,709 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:06:25,709 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 07:06:25,709 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-22 07:06:25,710 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-22 07:06:25,710 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-22 07:06:25,710 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43271,1690009574333' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-22 07:06:25,711 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-22 07:06:25,711 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34707,1690009574173' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-22 07:06:25,711 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-22 07:06:25,711 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-22 07:06:25,711 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:06:25,712 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-22 07:06:25,712 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-22 07:06:25,712 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44269,1690009574260' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-22 07:06:25,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-22 07:06:25,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-22 07:06:25,714 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 07:06:25,714 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 07:06:25,714 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:25,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:25,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:06:25,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:06:25,715 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 07:06:25,715 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 07:06:25,715 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 07:06:25,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:06:25,715 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:25,715 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 07:06:25,715 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 07:06:25,715 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 07:06:25,716 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 07:06:25,715 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 07:06:25,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:06:25,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 07:06:25,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:25,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:25,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:25,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:06:25,718 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43271,1690009574333' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-22 07:06:25,718 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@93112c3[Count = 1] remaining members to acquire global barrier 2023-07-22 07:06:25,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:25,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:06:25,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:06:25,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:06:25,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:06:25,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 07:06:25,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:25,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:25,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:25,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:06:25,721 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34707,1690009574173' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-22 07:06:25,721 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@93112c3[Count = 0] remaining members to acquire global barrier 2023-07-22 07:06:25,721 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-22 07:06:25,721 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 07:06:25,726 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 07:06:25,726 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 07:06:25,726 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 07:06:25,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 07:06:25,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 07:06:25,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 07:06:25,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 07:06:25,727 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-22 07:06:25,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 07:06:25,727 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:25,727 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 07:06:25,727 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 07:06:25,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 07:06:25,727 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1690009583569.fd702076a4a34554b12353062b4e614f. 2023-07-22 07:06:25,727 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-22 07:06:25,727 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-22 07:06:25,727 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1690009583569.fd702076a4a34554b12353062b4e614f. started... 2023-07-22 07:06:25,727 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 07:06:25,727 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 07:06:25,727 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:25,727 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-22 07:06:25,727 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 07:06:25,727 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1690009583569.76744faeabda2e1fb4144cfb9d7cfbc8. 2023-07-22 07:06:25,728 INFO [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] regionserver.HRegion(2745): Flushing fd702076a4a34554b12353062b4e614f 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-22 07:06:25,727 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44269,1690009574260' in zk 2023-07-22 07:06:25,728 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1690009583569.76744faeabda2e1fb4144cfb9d7cfbc8. started... 2023-07-22 07:06:25,728 INFO [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 76744faeabda2e1fb4144cfb9d7cfbc8 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-22 07:06:25,730 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-22 07:06:25,730 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:06:25,730 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-22 07:06:25,885 INFO [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230722ad5e97d1d9e5431ba54b4c59c34cdc68 to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230722ad5e97d1d9e5431ba54b4c59c34cdc68 2023-07-22 07:06:25,885 INFO [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307224bdcda1006d144e1858e292cbe388ebf to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307224bdcda1006d144e1858e292cbe388ebf 2023-07-22 07:06:25,914 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 07:06:25,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-22 07:06:25,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-22 07:06:25,932 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-22 07:06:25,935 INFO [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportWithTargetName/76744faeabda2e1fb4144cfb9d7cfbc8/.tmp/cf/834bc3de6a524ef18b4e3b7f4a399c81 2023-07-22 07:06:25,937 INFO [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportWithTargetName/fd702076a4a34554b12353062b4e614f/.tmp/cf/ab148cad532d4949824c64669ff332f3 2023-07-22 07:06:25,948 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportWithTargetName/76744faeabda2e1fb4144cfb9d7cfbc8/.tmp/cf/834bc3de6a524ef18b4e3b7f4a399c81 as hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportWithTargetName/76744faeabda2e1fb4144cfb9d7cfbc8/cf/834bc3de6a524ef18b4e3b7f4a399c81 2023-07-22 07:06:25,948 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportWithTargetName/fd702076a4a34554b12353062b4e614f/.tmp/cf/ab148cad532d4949824c64669ff332f3 as hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportWithTargetName/fd702076a4a34554b12353062b4e614f/cf/ab148cad532d4949824c64669ff332f3 2023-07-22 07:06:25,957 INFO [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportWithTargetName/76744faeabda2e1fb4144cfb9d7cfbc8/cf/834bc3de6a524ef18b4e3b7f4a399c81, entries=2, sequenceid=6, filesize=5.2 K 2023-07-22 07:06:25,959 INFO [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportWithTargetName/fd702076a4a34554b12353062b4e614f/cf/ab148cad532d4949824c64669ff332f3, entries=48, sequenceid=6, filesize=13.0 K 2023-07-22 07:06:25,963 INFO [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 76744faeabda2e1fb4144cfb9d7cfbc8 in 235ms, sequenceid=6, compaction requested=false 2023-07-22 07:06:25,963 INFO [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for fd702076a4a34554b12353062b4e614f in 236ms, sequenceid=6, compaction requested=false 2023-07-22 07:06:25,963 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-22 07:06:25,963 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-22 07:06:25,966 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 76744faeabda2e1fb4144cfb9d7cfbc8: 2023-07-22 07:06:25,966 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fd702076a4a34554b12353062b4e614f: 2023-07-22 07:06:25,967 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1690009583569.76744faeabda2e1fb4144cfb9d7cfbc8.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-22 07:06:25,967 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1690009583569.fd702076a4a34554b12353062b4e614f.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-22 07:06:25,967 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 07:06:25,967 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 07:06:25,967 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportWithTargetName/76744faeabda2e1fb4144cfb9d7cfbc8/cf/834bc3de6a524ef18b4e3b7f4a399c81] hfiles 2023-07-22 07:06:25,967 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportWithTargetName/fd702076a4a34554b12353062b4e614f/cf/ab148cad532d4949824c64669ff332f3] hfiles 2023-07-22 07:06:25,967 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportWithTargetName/76744faeabda2e1fb4144cfb9d7cfbc8/cf/834bc3de6a524ef18b4e3b7f4a399c81 for snapshot=snaptb0-testExportWithTargetName 2023-07-22 07:06:25,967 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportWithTargetName/fd702076a4a34554b12353062b4e614f/cf/ab148cad532d4949824c64669ff332f3 for snapshot=snaptb0-testExportWithTargetName 2023-07-22 07:06:25,996 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1690009583569.76744faeabda2e1fb4144cfb9d7cfbc8. completed. 2023-07-22 07:06:25,996 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1690009583569.fd702076a4a34554b12353062b4e614f. completed. 2023-07-22 07:06:25,996 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1690009583569.76744faeabda2e1fb4144cfb9d7cfbc8. 2023-07-22 07:06:25,996 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1690009583569.fd702076a4a34554b12353062b4e614f. 2023-07-22 07:06:25,996 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 07:06:25,996 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 07:06:25,996 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:25,996 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 07:06:25,997 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-22 07:06:25,997 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 07:06:25,997 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43271,1690009574333' in zk 2023-07-22 07:06:25,997 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:25,997 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-22 07:06:25,997 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34707,1690009574173' in zk 2023-07-22 07:06:25,999 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:25,999 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-22 07:06:25,999 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:06:25,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:26,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:06:26,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:06:25,999 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-22 07:06:25,999 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-22 07:06:25,999 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:26,000 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:06:26,000 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-22 07:06:26,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:06:26,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:06:26,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 07:06:26,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:26,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:26,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:26,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:06:26,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 07:06:26,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:26,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:26,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:26,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43271,1690009574333': 2023-07-22 07:06:26,005 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43271,1690009574333' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-22 07:06:26,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:26,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:06:26,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:06:26,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:06:26,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:06:26,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 07:06:26,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:26,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:26,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:26,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:06:26,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 07:06:26,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:26,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:26,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:26,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,34707,1690009574173': 2023-07-22 07:06:26,010 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34707,1690009574173' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-22 07:06:26,010 INFO [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-22 07:06:26,010 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 07:06:26,010 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 07:06:26,010 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-22 07:06:26,010 INFO [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 07:06:26,012 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 07:06:26,012 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 07:06:26,012 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:06:26,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 07:06:26,012 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 07:06:26,012 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 07:06:26,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 07:06:26,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 07:06:26,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:06:26,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:06:26,012 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:06:26,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 07:06:26,012 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:06:26,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 07:06:26,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 07:06:26,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 07:06:26,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:06:26,012 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:26,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:06:26,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:06:26,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:06:26,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:06:26,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 07:06:26,013 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:26,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:06:26,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:06:26,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 07:06:26,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 07:06:26,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 07:06:26,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:06:26,017 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:26,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 07:06:26,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:26,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:26,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:26,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:06:26,019 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:26,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 07:06:26,019 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:26,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:26,020 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:26,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:26,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:26,034 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:06:26,034 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:06:26,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:06:26,034 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:06:26,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:06:26,035 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:06:26,034 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:06:26,034 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:26,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:06:26,035 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 07:06:26,035 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:06:26,035 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:26,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:06:26,035 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-22 07:06:26,035 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:06:26,035 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-22 07:06:26,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:06:26,035 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:26,036 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-22 07:06:26,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:06:26,036 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-22 07:06:26,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:06:26,036 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 07:06:26,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:06:26,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:06:26,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:06:26,036 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:26,036 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 07:06:26,037 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:26,037 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:26,037 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 07:06:26,037 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 07:06:26,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:06:26,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:06:26,037 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230722ad5e97d1d9e5431ba54b4c59c34cdc68, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307224bdcda1006d144e1858e292cbe388ebf] mob files 2023-07-22 07:06:26,038 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230722ad5e97d1d9e5431ba54b4c59c34cdc68 2023-07-22 07:06:26,038 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307224bdcda1006d144e1858e292cbe388ebf 2023-07-22 07:06:26,050 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-22 07:06:26,051 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-22 07:06:26,094 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-22 07:06:26,141 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-22 07:06:26,141 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-22 07:06:26,142 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-22 07:06:26,142 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1690009585607Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1690009586050 (+443 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1690009586050Loading Region manifests for snaptb0-testExportWithTargetName at 1690009586050Writing data manifest for snaptb0-testExportWithTargetName at 1690009586056 (+6 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1690009586081 (+25 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1690009586141 (+60 ms) 2023-07-22 07:06:26,144 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-22 07:06:26,149 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 537 msec 2023-07-22 07:06:26,232 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 07:06:26,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-22 07:06:26,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 07:06:26,237 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009586237 2023-07-22 07:06:26,237 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45491, tgtDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009586237, rawTgtDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009586237, srcFsUri=hdfs://localhost:45491, srcDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03 2023-07-22 07:06:26,320 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45491, inputRoot=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03 2023-07-22 07:06:26,321 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2095857724_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009586237, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009586237/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-22 07:06:26,321 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45491, inputRoot=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03, snapshotDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-22 07:06:26,356 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009586237/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-22 07:06:26,534 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-22 07:06:26,535 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-22 07:06:26,535 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-22 07:06:26,536 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-22 07:06:26,536 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-22 07:06:26,537 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-22 07:06:26,537 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-22 07:06:26,627 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/hadoop-3338980081776014057.jar 2023-07-22 07:06:26,627 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-22 07:06:26,628 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-22 07:06:26,628 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-22 07:06:26,629 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-22 07:06:26,629 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-22 07:06:26,630 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-22 07:06:26,630 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-22 07:06:26,631 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-22 07:06:26,632 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-22 07:06:26,632 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-22 07:06:26,633 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-22 07:06:26,633 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-22 07:06:26,634 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-22 07:06:26,634 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-22 07:06:26,634 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-22 07:06:26,635 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-22 07:06:26,638 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 07:06:26,639 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 07:06:26,639 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 07:06:26,640 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 07:06:26,640 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 07:06:26,640 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 07:06:26,641 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 07:06:28,029 WARN [Listener at jenkins-hbase4.apache.org/45401] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-22 07:06:28,037 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-22 07:06:28,048 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-22 07:06:29,109 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 07:06:29,111 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 07:06:29,614 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690009582157_0001_000001 (auth:SIMPLE) 2023-07-22 07:06:29,634 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 07:06:34,845 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690009582157_0001_000001 (auth:SIMPLE) 2023-07-22 07:06:37,114 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690009582157_0001_000001 (auth:SIMPLE) 2023-07-22 07:06:41,211 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690009582157_0001_000001 (auth:SIMPLE) 2023-07-22 07:06:42,482 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-22 07:06:42,484 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-22 07:06:42,495 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-22 07:06:42,495 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-22 07:06:42,496 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-22 07:06:42,496 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_663023864_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-22 07:06:42,497 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(367): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-22 07:06:42,497 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(367): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-22 07:06:42,497 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_663023864_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009586237/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009586237/.hbase-snapshot/testExportWithTargetName 2023-07-22 07:06:42,498 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(367): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009586237/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-22 07:06:42,498 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(367): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009586237/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-22 07:06:42,508 INFO [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-22 07:06:42,513 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-22 07:06:42,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-22 07:06:42,530 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690009602530"}]},"ts":"1690009602530"} 2023-07-22 07:06:42,532 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-22 07:06:42,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-22 07:06:42,536 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-22 07:06:42,538 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=76744faeabda2e1fb4144cfb9d7cfbc8, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fd702076a4a34554b12353062b4e614f, UNASSIGN}] 2023-07-22 07:06:42,541 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=76744faeabda2e1fb4144cfb9d7cfbc8, UNASSIGN 2023-07-22 07:06:42,541 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fd702076a4a34554b12353062b4e614f, UNASSIGN 2023-07-22 07:06:42,543 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=fd702076a4a34554b12353062b4e614f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:42,543 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=76744faeabda2e1fb4144cfb9d7cfbc8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:42,543 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1690009583569.fd702076a4a34554b12353062b4e614f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690009602543"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690009602543"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690009602543"}]},"ts":"1690009602543"} 2023-07-22 07:06:42,544 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1690009583569.76744faeabda2e1fb4144cfb9d7cfbc8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690009602543"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690009602543"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690009602543"}]},"ts":"1690009602543"} 2023-07-22 07:06:42,545 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure fd702076a4a34554b12353062b4e614f, server=jenkins-hbase4.apache.org,34707,1690009574173}] 2023-07-22 07:06:42,552 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure 76744faeabda2e1fb4144cfb9d7cfbc8, server=jenkins-hbase4.apache.org,43271,1690009574333}] 2023-07-22 07:06:42,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-22 07:06:42,705 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close fd702076a4a34554b12353062b4e614f 2023-07-22 07:06:42,705 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fd702076a4a34554b12353062b4e614f, disabling compactions & flushes 2023-07-22 07:06:42,706 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1690009583569.fd702076a4a34554b12353062b4e614f. 2023-07-22 07:06:42,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1690009583569.fd702076a4a34554b12353062b4e614f. 2023-07-22 07:06:42,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1690009583569.fd702076a4a34554b12353062b4e614f. after waiting 0 ms 2023-07-22 07:06:42,706 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 76744faeabda2e1fb4144cfb9d7cfbc8 2023-07-22 07:06:42,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1690009583569.fd702076a4a34554b12353062b4e614f. 2023-07-22 07:06:42,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 76744faeabda2e1fb4144cfb9d7cfbc8, disabling compactions & flushes 2023-07-22 07:06:42,706 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1690009583569.76744faeabda2e1fb4144cfb9d7cfbc8. 2023-07-22 07:06:42,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1690009583569.76744faeabda2e1fb4144cfb9d7cfbc8. 2023-07-22 07:06:42,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1690009583569.76744faeabda2e1fb4144cfb9d7cfbc8. after waiting 0 ms 2023-07-22 07:06:42,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1690009583569.76744faeabda2e1fb4144cfb9d7cfbc8. 2023-07-22 07:06:42,724 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportWithTargetName/fd702076a4a34554b12353062b4e614f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 07:06:42,724 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportWithTargetName/76744faeabda2e1fb4144cfb9d7cfbc8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 07:06:42,724 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 07:06:42,726 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1690009583569.fd702076a4a34554b12353062b4e614f. 2023-07-22 07:06:42,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fd702076a4a34554b12353062b4e614f: 2023-07-22 07:06:42,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 07:06:42,727 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1690009583569.76744faeabda2e1fb4144cfb9d7cfbc8. 2023-07-22 07:06:42,727 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 76744faeabda2e1fb4144cfb9d7cfbc8: 2023-07-22 07:06:42,729 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed fd702076a4a34554b12353062b4e614f 2023-07-22 07:06:42,730 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=fd702076a4a34554b12353062b4e614f, regionState=CLOSED 2023-07-22 07:06:42,731 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1690009583569.fd702076a4a34554b12353062b4e614f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690009602730"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690009602730"}]},"ts":"1690009602730"} 2023-07-22 07:06:42,731 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 76744faeabda2e1fb4144cfb9d7cfbc8 2023-07-22 07:06:42,732 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=76744faeabda2e1fb4144cfb9d7cfbc8, regionState=CLOSED 2023-07-22 07:06:42,733 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1690009583569.76744faeabda2e1fb4144cfb9d7cfbc8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690009602732"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690009602732"}]},"ts":"1690009602732"} 2023-07-22 07:06:42,739 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-22 07:06:42,739 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure fd702076a4a34554b12353062b4e614f, server=jenkins-hbase4.apache.org,34707,1690009574173 in 190 msec 2023-07-22 07:06:42,740 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-22 07:06:42,740 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure 76744faeabda2e1fb4144cfb9d7cfbc8, server=jenkins-hbase4.apache.org,43271,1690009574333 in 185 msec 2023-07-22 07:06:42,741 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fd702076a4a34554b12353062b4e614f, UNASSIGN in 201 msec 2023-07-22 07:06:42,742 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-22 07:06:42,742 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=76744faeabda2e1fb4144cfb9d7cfbc8, UNASSIGN in 202 msec 2023-07-22 07:06:42,745 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690009602745"}]},"ts":"1690009602745"} 2023-07-22 07:06:42,747 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-22 07:06:42,750 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-22 07:06:42,754 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 234 msec 2023-07-22 07:06:42,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-22 07:06:42,837 INFO [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-22 07:06:42,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-22 07:06:42,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-22 07:06:42,851 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-22 07:06:42,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-22 07:06:42,854 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-22 07:06:42,857 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44269] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-22 07:06:42,859 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportWithTargetName/76744faeabda2e1fb4144cfb9d7cfbc8 2023-07-22 07:06:42,859 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportWithTargetName/fd702076a4a34554b12353062b4e614f 2023-07-22 07:06:42,860 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-22 07:06:42,860 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-22 07:06:42,860 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-22 07:06:42,860 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-22 07:06:42,862 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:06:42,862 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:06:42,862 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:06:42,862 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-22 07:06:42,862 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-22 07:06:42,862 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-22 07:06:42,862 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-22 07:06:42,862 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:06:42,863 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-22 07:06:42,863 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-22 07:06:42,863 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-22 07:06:42,863 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-22 07:06:42,864 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportWithTargetName/fd702076a4a34554b12353062b4e614f/cf, FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportWithTargetName/fd702076a4a34554b12353062b4e614f/recovered.edits] 2023-07-22 07:06:42,864 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportWithTargetName/76744faeabda2e1fb4144cfb9d7cfbc8/cf, FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportWithTargetName/76744faeabda2e1fb4144cfb9d7cfbc8/recovered.edits] 2023-07-22 07:06:42,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-22 07:06:42,872 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportWithTargetName/76744faeabda2e1fb4144cfb9d7cfbc8/cf/834bc3de6a524ef18b4e3b7f4a399c81 to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/archive/data/default/testtb-testExportWithTargetName/76744faeabda2e1fb4144cfb9d7cfbc8/cf/834bc3de6a524ef18b4e3b7f4a399c81 2023-07-22 07:06:42,872 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportWithTargetName/fd702076a4a34554b12353062b4e614f/cf/ab148cad532d4949824c64669ff332f3 to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/archive/data/default/testtb-testExportWithTargetName/fd702076a4a34554b12353062b4e614f/cf/ab148cad532d4949824c64669ff332f3 2023-07-22 07:06:42,876 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportWithTargetName/76744faeabda2e1fb4144cfb9d7cfbc8/recovered.edits/9.seqid to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/archive/data/default/testtb-testExportWithTargetName/76744faeabda2e1fb4144cfb9d7cfbc8/recovered.edits/9.seqid 2023-07-22 07:06:42,876 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportWithTargetName/fd702076a4a34554b12353062b4e614f/recovered.edits/9.seqid to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/archive/data/default/testtb-testExportWithTargetName/fd702076a4a34554b12353062b4e614f/recovered.edits/9.seqid 2023-07-22 07:06:42,876 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportWithTargetName/76744faeabda2e1fb4144cfb9d7cfbc8 2023-07-22 07:06:42,876 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportWithTargetName/fd702076a4a34554b12353062b4e614f 2023-07-22 07:06:42,877 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-22 07:06:42,877 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-22 07:06:42,878 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-22 07:06:42,881 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230722ad5e97d1d9e5431ba54b4c59c34cdc68 to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230722ad5e97d1d9e5431ba54b4c59c34cdc68 2023-07-22 07:06:42,883 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307224bdcda1006d144e1858e292cbe388ebf to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307224bdcda1006d144e1858e292cbe388ebf 2023-07-22 07:06:42,883 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-22 07:06:42,886 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-22 07:06:42,908 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-22 07:06:42,911 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-22 07:06:42,913 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-22 07:06:42,913 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-22 07:06:42,913 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1690009583569.76744faeabda2e1fb4144cfb9d7cfbc8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690009602913"}]},"ts":"9223372036854775807"} 2023-07-22 07:06:42,913 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1690009583569.fd702076a4a34554b12353062b4e614f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690009602913"}]},"ts":"9223372036854775807"} 2023-07-22 07:06:42,915 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-22 07:06:42,915 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 76744faeabda2e1fb4144cfb9d7cfbc8, NAME => 'testtb-testExportWithTargetName,,1690009583569.76744faeabda2e1fb4144cfb9d7cfbc8.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => fd702076a4a34554b12353062b4e614f, NAME => 'testtb-testExportWithTargetName,1,1690009583569.fd702076a4a34554b12353062b4e614f.', STARTKEY => '1', ENDKEY => ''}] 2023-07-22 07:06:42,915 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-22 07:06:42,916 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690009602915"}]},"ts":"9223372036854775807"} 2023-07-22 07:06:42,917 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-22 07:06:42,920 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-22 07:06:42,921 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 77 msec 2023-07-22 07:06:42,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-22 07:06:42,968 INFO [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-22 07:06:42,986 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-22 07:06:42,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-22 07:06:42,991 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-22 07:06:42,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-22 07:06:43,024 INFO [Listener at jenkins-hbase4.apache.org/45401] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=755 (was 704) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1203180535) connection to jenkins-hbase4.apache.org/172.31.14.131:46463 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1203180535) connection to jenkins-hbase4.apache.org/172.31.14.131:46175 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_663023864_17 at /127.0.0.1:35074 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/cluster_09dad59a-c8af-d239-c3a5-237708feddb2/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_663023864_17 at /127.0.0.1:41972 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/cluster_09dad59a-c8af-d239-c3a5-237708feddb2/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/cluster_09dad59a-c8af-d239-c3a5-237708feddb2/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6ff205ea-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1203180535) connection to jenkins-hbase4.apache.org/172.31.14.131:33283 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-402922376_1 at /127.0.0.1:35046 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/cluster_09dad59a-c8af-d239-c3a5-237708feddb2/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6ff205ea-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1317 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x6ff205ea-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6ff205ea-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/cluster_09dad59a-c8af-d239-c3a5-237708feddb2/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_663023864_17 at /127.0.0.1:35474 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-402922376_1 at /127.0.0.1:35452 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/cluster_09dad59a-c8af-d239-c3a5-237708feddb2/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=936 (was 901) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=376 (was 322) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 173) - ProcessCount LEAK? -, AvailableMemoryMB=6642 (was 8553) 2023-07-22 07:06:43,025 WARN [Listener at jenkins-hbase4.apache.org/45401] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-07-22 07:06:43,045 INFO [Listener at jenkins-hbase4.apache.org/45401] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=755, OpenFileDescriptor=936, MaxFileDescriptor=60000, SystemLoadAverage=376, ProcessCount=179, AvailableMemoryMB=6640 2023-07-22 07:06:43,045 WARN [Listener at jenkins-hbase4.apache.org/45401] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-07-22 07:06:43,047 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-22 07:06:43,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-22 07:06:43,052 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 07:06:43,054 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-22 07:06:43,055 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 07:06:43,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-22 07:06:43,058 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemState/560632f569d6e50548da13fc81ec6164 2023-07-22 07:06:43,058 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemState/151e7930118d1b96fb5972fc3a112191 2023-07-22 07:06:43,058 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemState/560632f569d6e50548da13fc81ec6164 empty. 2023-07-22 07:06:43,058 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemState/151e7930118d1b96fb5972fc3a112191 empty. 2023-07-22 07:06:43,059 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemState/560632f569d6e50548da13fc81ec6164 2023-07-22 07:06:43,059 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemState/151e7930118d1b96fb5972fc3a112191 2023-07-22 07:06:43,059 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-22 07:06:43,078 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-22 07:06:43,080 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 560632f569d6e50548da13fc81ec6164, NAME => 'testtb-testExportFileSystemState,,1690009603047.560632f569d6e50548da13fc81ec6164.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp 2023-07-22 07:06:43,080 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 151e7930118d1b96fb5972fc3a112191, NAME => 'testtb-testExportFileSystemState,1,1690009603047.151e7930118d1b96fb5972fc3a112191.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp 2023-07-22 07:06:43,092 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1690009603047.560632f569d6e50548da13fc81ec6164.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 07:06:43,094 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 560632f569d6e50548da13fc81ec6164, disabling compactions & flushes 2023-07-22 07:06:43,094 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1690009603047.560632f569d6e50548da13fc81ec6164. 2023-07-22 07:06:43,094 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1690009603047.560632f569d6e50548da13fc81ec6164. 2023-07-22 07:06:43,094 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1690009603047.560632f569d6e50548da13fc81ec6164. after waiting 0 ms 2023-07-22 07:06:43,094 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1690009603047.560632f569d6e50548da13fc81ec6164. 2023-07-22 07:06:43,094 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1690009603047.560632f569d6e50548da13fc81ec6164. 2023-07-22 07:06:43,094 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 560632f569d6e50548da13fc81ec6164: 2023-07-22 07:06:43,096 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1690009603047.151e7930118d1b96fb5972fc3a112191.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 07:06:43,097 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 151e7930118d1b96fb5972fc3a112191, disabling compactions & flushes 2023-07-22 07:06:43,097 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1690009603047.151e7930118d1b96fb5972fc3a112191. 2023-07-22 07:06:43,097 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1690009603047.151e7930118d1b96fb5972fc3a112191. 2023-07-22 07:06:43,097 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1690009603047.151e7930118d1b96fb5972fc3a112191. after waiting 0 ms 2023-07-22 07:06:43,097 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1690009603047.151e7930118d1b96fb5972fc3a112191. 2023-07-22 07:06:43,097 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1690009603047.151e7930118d1b96fb5972fc3a112191. 2023-07-22 07:06:43,097 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 151e7930118d1b96fb5972fc3a112191: 2023-07-22 07:06:43,100 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 07:06:43,101 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1690009603047.560632f569d6e50548da13fc81ec6164.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690009603101"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690009603101"}]},"ts":"1690009603101"} 2023-07-22 07:06:43,101 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1690009603047.151e7930118d1b96fb5972fc3a112191.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690009603101"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690009603101"}]},"ts":"1690009603101"} 2023-07-22 07:06:43,104 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-22 07:06:43,105 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 07:06:43,105 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690009603105"}]},"ts":"1690009603105"} 2023-07-22 07:06:43,107 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-22 07:06:43,111 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 07:06:43,112 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 07:06:43,112 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 07:06:43,112 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 07:06:43,113 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 07:06:43,113 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=560632f569d6e50548da13fc81ec6164, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=151e7930118d1b96fb5972fc3a112191, ASSIGN}] 2023-07-22 07:06:43,116 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=151e7930118d1b96fb5972fc3a112191, ASSIGN 2023-07-22 07:06:43,116 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=560632f569d6e50548da13fc81ec6164, ASSIGN 2023-07-22 07:06:43,117 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=151e7930118d1b96fb5972fc3a112191, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43271,1690009574333; forceNewPlan=false, retain=false 2023-07-22 07:06:43,118 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=560632f569d6e50548da13fc81ec6164, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34707,1690009574173; forceNewPlan=false, retain=false 2023-07-22 07:06:43,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-22 07:06:43,268 INFO [jenkins-hbase4:44609] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-22 07:06:43,270 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=151e7930118d1b96fb5972fc3a112191, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:43,270 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=560632f569d6e50548da13fc81ec6164, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:43,271 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1690009603047.151e7930118d1b96fb5972fc3a112191.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690009603270"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690009603270"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690009603270"}]},"ts":"1690009603270"} 2023-07-22 07:06:43,271 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1690009603047.560632f569d6e50548da13fc81ec6164.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690009603270"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690009603270"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690009603270"}]},"ts":"1690009603270"} 2023-07-22 07:06:43,273 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 151e7930118d1b96fb5972fc3a112191, server=jenkins-hbase4.apache.org,43271,1690009574333}] 2023-07-22 07:06:43,274 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 560632f569d6e50548da13fc81ec6164, server=jenkins-hbase4.apache.org,34707,1690009574173}] 2023-07-22 07:06:43,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-22 07:06:43,430 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1690009603047.151e7930118d1b96fb5972fc3a112191. 2023-07-22 07:06:43,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 151e7930118d1b96fb5972fc3a112191, NAME => 'testtb-testExportFileSystemState,1,1690009603047.151e7930118d1b96fb5972fc3a112191.', STARTKEY => '1', ENDKEY => ''} 2023-07-22 07:06:43,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1690009603047.151e7930118d1b96fb5972fc3a112191. service=AccessControlService 2023-07-22 07:06:43,431 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 07:06:43,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 151e7930118d1b96fb5972fc3a112191 2023-07-22 07:06:43,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1690009603047.151e7930118d1b96fb5972fc3a112191.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 07:06:43,431 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1690009603047.560632f569d6e50548da13fc81ec6164. 2023-07-22 07:06:43,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 151e7930118d1b96fb5972fc3a112191 2023-07-22 07:06:43,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 151e7930118d1b96fb5972fc3a112191 2023-07-22 07:06:43,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 560632f569d6e50548da13fc81ec6164, NAME => 'testtb-testExportFileSystemState,,1690009603047.560632f569d6e50548da13fc81ec6164.', STARTKEY => '', ENDKEY => '1'} 2023-07-22 07:06:43,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1690009603047.560632f569d6e50548da13fc81ec6164. service=AccessControlService 2023-07-22 07:06:43,432 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 07:06:43,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 560632f569d6e50548da13fc81ec6164 2023-07-22 07:06:43,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1690009603047.560632f569d6e50548da13fc81ec6164.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 07:06:43,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 560632f569d6e50548da13fc81ec6164 2023-07-22 07:06:43,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 560632f569d6e50548da13fc81ec6164 2023-07-22 07:06:43,433 INFO [StoreOpener-151e7930118d1b96fb5972fc3a112191-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 151e7930118d1b96fb5972fc3a112191 2023-07-22 07:06:43,435 INFO [StoreOpener-560632f569d6e50548da13fc81ec6164-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 560632f569d6e50548da13fc81ec6164 2023-07-22 07:06:43,435 DEBUG [StoreOpener-151e7930118d1b96fb5972fc3a112191-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemState/151e7930118d1b96fb5972fc3a112191/cf 2023-07-22 07:06:43,435 DEBUG [StoreOpener-151e7930118d1b96fb5972fc3a112191-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemState/151e7930118d1b96fb5972fc3a112191/cf 2023-07-22 07:06:43,436 INFO [StoreOpener-151e7930118d1b96fb5972fc3a112191-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 151e7930118d1b96fb5972fc3a112191 columnFamilyName cf 2023-07-22 07:06:43,438 DEBUG [StoreOpener-560632f569d6e50548da13fc81ec6164-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemState/560632f569d6e50548da13fc81ec6164/cf 2023-07-22 07:06:43,438 DEBUG [StoreOpener-560632f569d6e50548da13fc81ec6164-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemState/560632f569d6e50548da13fc81ec6164/cf 2023-07-22 07:06:43,439 INFO [StoreOpener-560632f569d6e50548da13fc81ec6164-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 560632f569d6e50548da13fc81ec6164 columnFamilyName cf 2023-07-22 07:06:43,440 INFO [StoreOpener-151e7930118d1b96fb5972fc3a112191-1] regionserver.HStore(310): Store=151e7930118d1b96fb5972fc3a112191/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 07:06:43,442 INFO [StoreOpener-560632f569d6e50548da13fc81ec6164-1] regionserver.HStore(310): Store=560632f569d6e50548da13fc81ec6164/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 07:06:43,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemState/560632f569d6e50548da13fc81ec6164 2023-07-22 07:06:43,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemState/151e7930118d1b96fb5972fc3a112191 2023-07-22 07:06:43,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemState/151e7930118d1b96fb5972fc3a112191 2023-07-22 07:06:43,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemState/560632f569d6e50548da13fc81ec6164 2023-07-22 07:06:43,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 151e7930118d1b96fb5972fc3a112191 2023-07-22 07:06:43,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 560632f569d6e50548da13fc81ec6164 2023-07-22 07:06:43,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemState/151e7930118d1b96fb5972fc3a112191/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 07:06:43,454 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 151e7930118d1b96fb5972fc3a112191; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66054099, jitterRate=-0.015717223286628723}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 07:06:43,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 151e7930118d1b96fb5972fc3a112191: 2023-07-22 07:06:43,455 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1690009603047.151e7930118d1b96fb5972fc3a112191., pid=30, masterSystemTime=1690009603425 2023-07-22 07:06:43,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemState/560632f569d6e50548da13fc81ec6164/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 07:06:43,457 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 560632f569d6e50548da13fc81ec6164; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70739542, jitterRate=0.05410131812095642}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 07:06:43,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 560632f569d6e50548da13fc81ec6164: 2023-07-22 07:06:43,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1690009603047.151e7930118d1b96fb5972fc3a112191. 2023-07-22 07:06:43,459 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1690009603047.151e7930118d1b96fb5972fc3a112191. 2023-07-22 07:06:43,459 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1690009603047.560632f569d6e50548da13fc81ec6164., pid=31, masterSystemTime=1690009603427 2023-07-22 07:06:43,460 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=151e7930118d1b96fb5972fc3a112191, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:43,460 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1690009603047.151e7930118d1b96fb5972fc3a112191.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690009603459"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690009603459"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690009603459"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690009603459"}]},"ts":"1690009603459"} 2023-07-22 07:06:43,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1690009603047.560632f569d6e50548da13fc81ec6164. 2023-07-22 07:06:43,462 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1690009603047.560632f569d6e50548da13fc81ec6164. 2023-07-22 07:06:43,466 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=560632f569d6e50548da13fc81ec6164, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:43,472 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1690009603047.560632f569d6e50548da13fc81ec6164.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690009603465"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690009603465"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690009603465"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690009603465"}]},"ts":"1690009603465"} 2023-07-22 07:06:43,482 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-22 07:06:43,482 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 151e7930118d1b96fb5972fc3a112191, server=jenkins-hbase4.apache.org,43271,1690009574333 in 199 msec 2023-07-22 07:06:43,484 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-22 07:06:43,484 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 560632f569d6e50548da13fc81ec6164, server=jenkins-hbase4.apache.org,34707,1690009574173 in 204 msec 2023-07-22 07:06:43,485 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=151e7930118d1b96fb5972fc3a112191, ASSIGN in 369 msec 2023-07-22 07:06:43,487 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-22 07:06:43,487 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=560632f569d6e50548da13fc81ec6164, ASSIGN in 371 msec 2023-07-22 07:06:43,488 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 07:06:43,488 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690009603488"}]},"ts":"1690009603488"} 2023-07-22 07:06:43,490 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-22 07:06:43,494 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 07:06:43,494 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-22 07:06:43,496 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44269] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-22 07:06:43,498 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:06:43,498 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:06:43,498 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:06:43,498 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:06:43,500 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 07:06:43,500 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 07:06:43,501 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 07:06:43,501 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 07:06:43,502 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 452 msec 2023-07-22 07:06:43,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-22 07:06:43,660 INFO [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-22 07:06:43,662 DEBUG [Listener at jenkins-hbase4.apache.org/45401] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-22 07:06:43,662 DEBUG [Listener at jenkins-hbase4.apache.org/45401] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1690009603047.560632f569d6e50548da13fc81ec6164. 2023-07-22 07:06:43,665 INFO [Listener at jenkins-hbase4.apache.org/45401] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 07:06:43,692 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 07:06:43,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690009603692 (current time:1690009603692). 2023-07-22 07:06:43,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 07:06:43,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(139): Connect 0x049a397a to 127.0.0.1:63277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 07:06:43,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ca78336, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 07:06:43,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 07:06:43,707 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53196, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 07:06:43,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x049a397a to 127.0.0.1:63277 2023-07-22 07:06:43,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 07:06:43,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(139): Connect 0x4c039aa2 to 127.0.0.1:63277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 07:06:43,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@19072bb1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 07:06:43,718 DEBUG [hconnection-0x9a9a594-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 07:06:43,720 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53212, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 07:06:43,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 07:06:43,727 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34072, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 07:06:43,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4c039aa2 to 127.0.0.1:63277 2023-07-22 07:06:43,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 07:06:43,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-22 07:06:43,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 07:06:43,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 07:06:43,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-22 07:06:43,735 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-22 07:06:43,735 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690010203735 2023-07-22 07:06:43,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 07:06:43,736 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-22 07:06:43,737 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 07:06:43,737 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 07:06:43,738 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-22 07:06:43,738 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-22 07:06:43,743 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-22 07:06:43,744 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-22 07:06:43,745 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690010203745 2023-07-22 07:06:43,760 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,760 INFO [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-22 07:06:43,760 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:06:43,761 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-22 07:06:43,762 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-22 07:06:43,762 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,762 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,764 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:06:43,764 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:06:43,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:06:43,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:06:43,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:06:43,764 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:43,764 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:06:43,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:06:43,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:06:43,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:06:43,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,765 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:43,765 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:43,766 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,766 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,766 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:43,766 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 07:06:43,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-22 07:06:43,766 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-22 07:06:43,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,766 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-22 07:06:43,766 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-22 07:06:43,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-22 07:06:43,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,767 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,767 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-22 07:06:43,767 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,767 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-22 07:06:43,768 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:06:43,768 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,772 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-22 07:06:43,772 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-22 07:06:43,772 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:06:43,772 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-22 07:06:43,773 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-22 07:06:43,773 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-22 07:06:43,774 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-22 07:06:43,774 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34707,1690009574173' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-22 07:06:43,773 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:06:43,773 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43271,1690009574333' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-22 07:06:43,775 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-22 07:06:43,775 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-22 07:06:43,775 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44269,1690009574260' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-22 07:06:43,778 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:43,778 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:43,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:06:43,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:06:43,782 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,782 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,782 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 07:06:43,782 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,782 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:43,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:06:43,782 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,782 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 07:06:43,782 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,783 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 07:06:43,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:06:43,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:43,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:43,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:43,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:06:43,785 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34707,1690009574173' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-22 07:06:43,785 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d597db8[Count = 1] remaining members to acquire global barrier 2023-07-22 07:06:43,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:43,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:06:43,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:06:43,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:06:43,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:06:43,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:43,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:43,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:43,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:06:43,788 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43271,1690009574333' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-22 07:06:43,789 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d597db8[Count = 0] remaining members to acquire global barrier 2023-07-22 07:06:43,789 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-22 07:06:43,789 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,790 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,790 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,790 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,790 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-22 07:06:43,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,791 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-22 07:06:43,791 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-22 07:06:43,791 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1690009603047.560632f569d6e50548da13fc81ec6164. 2023-07-22 07:06:43,791 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 07:06:43,791 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 07:06:43,791 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-22 07:06:43,791 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1690009603047.560632f569d6e50548da13fc81ec6164. started... 2023-07-22 07:06:43,791 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:43,791 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44269,1690009574260' in zk 2023-07-22 07:06:43,792 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:43,792 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 07:06:43,792 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 560632f569d6e50548da13fc81ec6164: 2023-07-22 07:06:43,793 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1690009603047.560632f569d6e50548da13fc81ec6164.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,793 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 07:06:43,793 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 07:06:43,795 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-22 07:06:43,795 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:06:43,795 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-22 07:06:43,798 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 07:06:43,800 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1690009603047.151e7930118d1b96fb5972fc3a112191. 2023-07-22 07:06:43,800 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 07:06:43,800 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1690009603047.151e7930118d1b96fb5972fc3a112191. started... 2023-07-22 07:06:43,802 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 151e7930118d1b96fb5972fc3a112191: 2023-07-22 07:06:43,802 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1690009603047.151e7930118d1b96fb5972fc3a112191.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,802 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 07:06:43,802 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 07:06:43,826 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1690009603047.560632f569d6e50548da13fc81ec6164. completed. 2023-07-22 07:06:43,826 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1690009603047.560632f569d6e50548da13fc81ec6164. 2023-07-22 07:06:43,826 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 07:06:43,826 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 07:06:43,826 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:43,826 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-22 07:06:43,826 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34707,1690009574173' in zk 2023-07-22 07:06:43,827 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1690009603047.151e7930118d1b96fb5972fc3a112191. completed. 2023-07-22 07:06:43,827 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1690009603047.151e7930118d1b96fb5972fc3a112191. 2023-07-22 07:06:43,827 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 07:06:43,827 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 07:06:43,828 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:43,828 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-22 07:06:43,828 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43271,1690009574333' in zk 2023-07-22 07:06:43,829 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:43,829 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-22 07:06:43,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:43,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:06:43,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:06:43,829 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:06:43,829 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-22 07:06:43,831 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:43,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:06:43,831 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-22 07:06:43,831 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:06:43,832 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-22 07:06:43,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:06:43,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:43,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:43,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:43,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:06:43,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:43,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:43,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:43,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34707,1690009574173': 2023-07-22 07:06:43,837 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34707,1690009574173' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-22 07:06:43,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:43,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:06:43,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:06:43,837 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 07:06:43,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:06:43,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:06:43,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 07:06:43,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-22 07:06:43,839 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 07:06:43,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:43,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:43,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:43,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:06:43,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:43,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:43,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:43,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43271,1690009574333': 2023-07-22 07:06:43,842 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43271,1690009574333' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-22 07:06:43,842 INFO [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-22 07:06:43,842 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 07:06:43,842 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 07:06:43,842 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,843 INFO [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 07:06:43,844 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,844 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,844 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:06:43,844 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,844 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:06:43,844 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,845 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:06:43,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,845 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:43,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:06:43,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:06:43,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:06:43,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:06:43,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:06:43,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:06:43,847 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:43,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:06:43,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:06:43,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,847 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:43,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:06:43,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:06:43,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:43,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:43,849 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:43,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:43,850 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:43,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:06:43,850 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:43,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:43,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:43,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:43,858 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:43,858 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,858 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:43,858 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:06:43,858 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:06:43,858 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:06:43,858 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:06:43,858 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:06:43,858 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:06:43,858 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:43,859 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,859 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:43,859 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,859 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:06:43,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:06:43,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:06:43,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:06:43,859 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,859 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:43,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:06:43,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:06:43,861 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:43,860 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-22 07:06:43,861 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,861 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,861 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,861 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-22 07:06:43,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:06:43,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:06:43,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:06:43,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:06:43,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:06:43,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:06:43,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:06:43,862 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-22 07:06:43,881 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,882 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,939 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,975 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-22 07:06:43,975 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,976 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:43,976 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1690009603736Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1690009603881 (+145 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1690009603881Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1690009603882 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemState at 1690009603887 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1690009603930 (+43 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1690009603975 (+45 ms) 2023-07-22 07:06:43,978 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-22 07:06:43,996 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 242 msec 2023-07-22 07:06:44,039 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 07:06:44,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 07:06:44,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 07:06:44,044 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34707] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1690009603047.560632f569d6e50548da13fc81ec6164. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 07:06:44,046 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43271] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1690009603047.151e7930118d1b96fb5972fc3a112191. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 07:06:44,050 DEBUG [Listener at jenkins-hbase4.apache.org/45401] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-22 07:06:44,051 DEBUG [Listener at jenkins-hbase4.apache.org/45401] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1690009603047.560632f569d6e50548da13fc81ec6164. 2023-07-22 07:06:44,051 INFO [Listener at jenkins-hbase4.apache.org/45401] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 07:06:44,062 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 07:06:44,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690009604063 (current time:1690009604063). 2023-07-22 07:06:44,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 07:06:44,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(139): Connect 0x116d1eda to 127.0.0.1:63277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 07:06:44,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@354789a8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 07:06:44,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 07:06:44,072 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53222, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 07:06:44,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x116d1eda to 127.0.0.1:63277 2023-07-22 07:06:44,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 07:06:44,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(139): Connect 0x42f76176 to 127.0.0.1:63277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 07:06:44,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3216e82f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 07:06:44,083 DEBUG [hconnection-0x2d408f40-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 07:06:44,085 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53226, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 07:06:44,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 07:06:44,091 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34086, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 07:06:44,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x42f76176 to 127.0.0.1:63277 2023-07-22 07:06:44,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 07:06:44,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-22 07:06:44,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 07:06:44,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 07:06:44,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-22 07:06:44,097 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-22 07:06:44,098 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690010204098 2023-07-22 07:06:44,098 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-22 07:06:44,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 07:06:44,099 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 07:06:44,100 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 07:06:44,101 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-22 07:06:44,102 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-22 07:06:44,103 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-22 07:06:44,104 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-22 07:06:44,105 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690010204105 2023-07-22 07:06:44,126 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-22 07:06:44,127 INFO [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-22 07:06:44,127 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:06:44,128 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-22 07:06:44,128 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-22 07:06:44,129 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,129 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,131 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:44,131 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:06:44,131 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:06:44,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:06:44,131 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:06:44,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:06:44,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:06:44,131 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:44,131 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:44,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:06:44,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:06:44,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:06:44,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,132 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:44,132 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 07:06:44,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,132 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,132 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,132 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-22 07:06:44,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-22 07:06:44,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,133 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-22 07:06:44,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-22 07:06:44,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,133 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-22 07:06:44,133 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-22 07:06:44,133 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-22 07:06:44,133 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-22 07:06:44,133 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-22 07:06:44,133 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:06:44,133 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-22 07:06:44,134 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:06:44,146 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-22 07:06:44,152 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-22 07:06:44,152 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-22 07:06:44,152 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:06:44,152 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-22 07:06:44,153 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-22 07:06:44,153 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-22 07:06:44,153 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-22 07:06:44,153 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34707,1690009574173' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-22 07:06:44,152 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-22 07:06:44,153 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43271,1690009574333' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-22 07:06:44,153 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44269,1690009574260' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-22 07:06:44,155 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:44,155 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:44,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:06:44,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:06:44,157 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,157 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,157 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:44,158 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,157 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 07:06:44,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:06:44,158 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,158 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 07:06:44,158 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,158 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 07:06:44,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:06:44,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 07:06:44,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:44,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:44,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:44,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:06:44,164 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43271,1690009574333' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-22 07:06:44,164 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b2b7d91[Count = 1] remaining members to acquire global barrier 2023-07-22 07:06:44,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:44,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:06:44,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:06:44,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:06:44,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:06:44,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 07:06:44,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:44,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:44,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:44,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:06:44,167 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34707,1690009574173' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-22 07:06:44,167 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b2b7d91[Count = 0] remaining members to acquire global barrier 2023-07-22 07:06:44,167 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-22 07:06:44,167 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,169 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,169 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,169 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,169 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-22 07:06:44,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,169 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:44,169 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-22 07:06:44,170 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-22 07:06:44,170 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44269,1690009574260' in zk 2023-07-22 07:06:44,169 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-22 07:06:44,170 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 07:06:44,170 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 07:06:44,170 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 07:06:44,170 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 07:06:44,170 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1690009603047.560632f569d6e50548da13fc81ec6164. 2023-07-22 07:06:44,170 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:44,170 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 07:06:44,170 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1690009603047.560632f569d6e50548da13fc81ec6164. started... 2023-07-22 07:06:44,170 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1690009603047.151e7930118d1b96fb5972fc3a112191. 2023-07-22 07:06:44,170 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1690009603047.151e7930118d1b96fb5972fc3a112191. started... 2023-07-22 07:06:44,170 INFO [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 560632f569d6e50548da13fc81ec6164 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-22 07:06:44,170 INFO [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 151e7930118d1b96fb5972fc3a112191 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-22 07:06:44,171 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-22 07:06:44,171 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:06:44,171 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-22 07:06:44,200 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 07:06:44,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 07:06:44,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-22 07:06:44,201 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 07:06:44,224 INFO [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023072244984750d9294cf8b92bf2628703985b to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023072244984750d9294cf8b92bf2628703985b 2023-07-22 07:06:44,236 INFO [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230722de1c7cf002774c728f41d497d7dded0f to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230722de1c7cf002774c728f41d497d7dded0f 2023-07-22 07:06:44,250 INFO [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemState/560632f569d6e50548da13fc81ec6164/.tmp/cf/cab08a13805d4605aa5d131e91f1836a 2023-07-22 07:06:44,253 INFO [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemState/151e7930118d1b96fb5972fc3a112191/.tmp/cf/0bef68e109c84e08950d8cb2bc7870fa 2023-07-22 07:06:44,258 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemState/560632f569d6e50548da13fc81ec6164/.tmp/cf/cab08a13805d4605aa5d131e91f1836a as hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemState/560632f569d6e50548da13fc81ec6164/cf/cab08a13805d4605aa5d131e91f1836a 2023-07-22 07:06:44,260 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemState/151e7930118d1b96fb5972fc3a112191/.tmp/cf/0bef68e109c84e08950d8cb2bc7870fa as hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemState/151e7930118d1b96fb5972fc3a112191/cf/0bef68e109c84e08950d8cb2bc7870fa 2023-07-22 07:06:44,264 INFO [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemState/560632f569d6e50548da13fc81ec6164/cf/cab08a13805d4605aa5d131e91f1836a, entries=4, sequenceid=6, filesize=5.6 K 2023-07-22 07:06:44,265 INFO [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 560632f569d6e50548da13fc81ec6164 in 95ms, sequenceid=6, compaction requested=false 2023-07-22 07:06:44,265 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-22 07:06:44,266 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 560632f569d6e50548da13fc81ec6164: 2023-07-22 07:06:44,266 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1690009603047.560632f569d6e50548da13fc81ec6164.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-22 07:06:44,266 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 07:06:44,266 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemState/560632f569d6e50548da13fc81ec6164/cf/cab08a13805d4605aa5d131e91f1836a] hfiles 2023-07-22 07:06:44,266 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemState/560632f569d6e50548da13fc81ec6164/cf/cab08a13805d4605aa5d131e91f1836a for snapshot=snaptb0-testExportFileSystemState 2023-07-22 07:06:44,268 INFO [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemState/151e7930118d1b96fb5972fc3a112191/cf/0bef68e109c84e08950d8cb2bc7870fa, entries=46, sequenceid=6, filesize=12.7 K 2023-07-22 07:06:44,269 INFO [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 151e7930118d1b96fb5972fc3a112191 in 99ms, sequenceid=6, compaction requested=false 2023-07-22 07:06:44,271 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 151e7930118d1b96fb5972fc3a112191: 2023-07-22 07:06:44,271 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1690009603047.151e7930118d1b96fb5972fc3a112191.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-22 07:06:44,271 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 07:06:44,271 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemState/151e7930118d1b96fb5972fc3a112191/cf/0bef68e109c84e08950d8cb2bc7870fa] hfiles 2023-07-22 07:06:44,271 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemState/151e7930118d1b96fb5972fc3a112191/cf/0bef68e109c84e08950d8cb2bc7870fa for snapshot=snaptb0-testExportFileSystemState 2023-07-22 07:06:44,285 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1690009603047.560632f569d6e50548da13fc81ec6164. completed. 2023-07-22 07:06:44,285 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1690009603047.560632f569d6e50548da13fc81ec6164. 2023-07-22 07:06:44,285 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 07:06:44,285 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 07:06:44,285 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:44,286 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-22 07:06:44,286 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34707,1690009574173' in zk 2023-07-22 07:06:44,289 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1690009603047.151e7930118d1b96fb5972fc3a112191. completed. 2023-07-22 07:06:44,289 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1690009603047.151e7930118d1b96fb5972fc3a112191. 2023-07-22 07:06:44,289 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 07:06:44,289 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 07:06:44,289 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:44,289 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-22 07:06:44,289 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43271,1690009574333' in zk 2023-07-22 07:06:44,294 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-22 07:06:44,295 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:06:44,295 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:44,295 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-22 07:06:44,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:44,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:06:44,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:06:44,297 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-22 07:06:44,297 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:44,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:06:44,297 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:06:44,298 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-22 07:06:44,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:06:44,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 07:06:44,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:44,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:44,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:44,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:06:44,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 07:06:44,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:44,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:44,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:44,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34707,1690009574173': 2023-07-22 07:06:44,304 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34707,1690009574173' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-22 07:06:44,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:44,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:06:44,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:06:44,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:06:44,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:06:44,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 07:06:44,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:44,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:44,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:44,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:06:44,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 07:06:44,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:44,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:44,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:44,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43271,1690009574333': 2023-07-22 07:06:44,309 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43271,1690009574333' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-22 07:06:44,309 INFO [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-22 07:06:44,309 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 07:06:44,309 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 07:06:44,309 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-22 07:06:44,309 INFO [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 07:06:44,311 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,311 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,311 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:06:44,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,311 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:06:44,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,312 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:06:44,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,311 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:06:44,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:06:44,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:06:44,312 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:06:44,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:06:44,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:06:44,312 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:44,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:06:44,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:06:44,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:06:44,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,313 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:44,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 07:06:44,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,313 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:44,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:06:44,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 07:06:44,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:44,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:44,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:44,315 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:44,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:06:44,316 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:44,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 07:06:44,316 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:44,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:44,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:44,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:44,319 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:06:44,319 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:06:44,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:06:44,319 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:44,319 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:06:44,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:06:44,319 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:06:44,319 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:06:44,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:06:44,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:06:44,319 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:06:44,320 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:44,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:06:44,320 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:44,320 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,320 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:06:44,320 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,320 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:44,320 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:44,320 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,320 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,322 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:06:44,322 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:06:44,322 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-22 07:06:44,324 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-22 07:06:44,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:06:44,324 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-22 07:06:44,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:06:44,324 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-22 07:06:44,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:06:44,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:06:44,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:06:44,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:06:44,325 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230722de1c7cf002774c728f41d497d7dded0f, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023072244984750d9294cf8b92bf2628703985b] mob files 2023-07-22 07:06:44,326 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230722de1c7cf002774c728f41d497d7dded0f 2023-07-22 07:06:44,326 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023072244984750d9294cf8b92bf2628703985b 2023-07-22 07:06:44,335 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-22 07:06:44,335 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,373 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,398 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-22 07:06:44,398 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,398 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,398 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1690009604098Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1690009604335 (+237 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1690009604335Loading Region manifests for snaptb0-testExportFileSystemState at 1690009604335Writing data manifest for snaptb0-testExportFileSystemState at 1690009604344 (+9 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1690009604359 (+15 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1690009604398 (+39 ms) 2023-07-22 07:06:44,401 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-22 07:06:44,401 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 07:06:44,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 07:06:44,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 07:06:44,403 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 302 msec 2023-07-22 07:06:44,403 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009604403 2023-07-22 07:06:44,403 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45491, tgtDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009604403, rawTgtDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009604403, srcFsUri=hdfs://localhost:45491, srcDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03 2023-07-22 07:06:44,428 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45491, inputRoot=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03 2023-07-22 07:06:44,428 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1363222084_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009604403, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009604403/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,428 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45491, inputRoot=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03, snapshotDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-22 07:06:44,442 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009604403/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-22 07:06:44,464 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-22 07:06:44,464 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-22 07:06:44,464 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-22 07:06:44,465 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-22 07:06:44,465 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-22 07:06:44,466 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-22 07:06:44,466 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-22 07:06:44,539 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/hadoop-1617393729820858629.jar 2023-07-22 07:06:44,539 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-22 07:06:44,540 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-22 07:06:44,540 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-22 07:06:44,540 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-22 07:06:44,541 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-22 07:06:44,541 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-22 07:06:44,541 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-22 07:06:44,542 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-22 07:06:44,542 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-22 07:06:44,542 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-22 07:06:44,543 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-22 07:06:44,543 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-22 07:06:44,543 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-22 07:06:44,544 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-22 07:06:44,544 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-22 07:06:44,545 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-22 07:06:44,545 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 07:06:44,546 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 07:06:44,547 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 07:06:44,547 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 07:06:44,547 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 07:06:44,548 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 07:06:44,549 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 07:06:45,071 WARN [Listener at jenkins-hbase4.apache.org/45401] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-22 07:06:45,074 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-22 07:06:45,077 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-22 07:06:47,416 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 07:06:47,416 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 07:06:47,422 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690009582157_0001_000001 (auth:SIMPLE) 2023-07-22 07:06:48,208 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690009582157_0002_000001 (auth:SIMPLE) 2023-07-22 07:06:48,320 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 07:06:53,101 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690009582157_0002_000001 (auth:SIMPLE) 2023-07-22 07:06:55,362 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690009582157_0002_000001 (auth:SIMPLE) 2023-07-22 07:06:58,258 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690009582157_0002_000001 (auth:SIMPLE) 2023-07-22 07:06:59,358 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-22 07:06:59,359 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-22 07:06:59,378 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-22 07:06:59,378 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-22 07:06:59,378 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-22 07:06:59,379 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_663023864_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-22 07:06:59,379 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(367): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-22 07:06:59,379 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(367): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-22 07:06:59,379 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_663023864_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009604403/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009604403/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-22 07:06:59,380 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(367): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009604403/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-22 07:06:59,380 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(367): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009604403/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-22 07:06:59,392 INFO [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-22 07:06:59,393 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-22 07:06:59,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-22 07:06:59,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-22 07:06:59,401 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690009619401"}]},"ts":"1690009619401"} 2023-07-22 07:06:59,403 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-22 07:06:59,405 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-22 07:06:59,407 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=560632f569d6e50548da13fc81ec6164, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=151e7930118d1b96fb5972fc3a112191, UNASSIGN}] 2023-07-22 07:06:59,408 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=151e7930118d1b96fb5972fc3a112191, UNASSIGN 2023-07-22 07:06:59,411 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=560632f569d6e50548da13fc81ec6164, UNASSIGN 2023-07-22 07:06:59,413 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=151e7930118d1b96fb5972fc3a112191, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:06:59,413 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1690009603047.151e7930118d1b96fb5972fc3a112191.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690009619413"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690009619413"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690009619413"}]},"ts":"1690009619413"} 2023-07-22 07:06:59,414 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=560632f569d6e50548da13fc81ec6164, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:06:59,414 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1690009603047.560632f569d6e50548da13fc81ec6164.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690009619413"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690009619413"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690009619413"}]},"ts":"1690009619413"} 2023-07-22 07:06:59,423 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 151e7930118d1b96fb5972fc3a112191, server=jenkins-hbase4.apache.org,43271,1690009574333}] 2023-07-22 07:06:59,424 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 560632f569d6e50548da13fc81ec6164, server=jenkins-hbase4.apache.org,34707,1690009574173}] 2023-07-22 07:06:59,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-22 07:06:59,577 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 560632f569d6e50548da13fc81ec6164 2023-07-22 07:06:59,577 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 151e7930118d1b96fb5972fc3a112191 2023-07-22 07:06:59,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 560632f569d6e50548da13fc81ec6164, disabling compactions & flushes 2023-07-22 07:06:59,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 151e7930118d1b96fb5972fc3a112191, disabling compactions & flushes 2023-07-22 07:06:59,578 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1690009603047.560632f569d6e50548da13fc81ec6164. 2023-07-22 07:06:59,578 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1690009603047.151e7930118d1b96fb5972fc3a112191. 2023-07-22 07:06:59,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1690009603047.560632f569d6e50548da13fc81ec6164. 2023-07-22 07:06:59,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1690009603047.151e7930118d1b96fb5972fc3a112191. 2023-07-22 07:06:59,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1690009603047.560632f569d6e50548da13fc81ec6164. after waiting 0 ms 2023-07-22 07:06:59,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1690009603047.151e7930118d1b96fb5972fc3a112191. after waiting 0 ms 2023-07-22 07:06:59,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1690009603047.560632f569d6e50548da13fc81ec6164. 2023-07-22 07:06:59,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1690009603047.151e7930118d1b96fb5972fc3a112191. 2023-07-22 07:06:59,592 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemState/560632f569d6e50548da13fc81ec6164/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 07:06:59,593 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemState/151e7930118d1b96fb5972fc3a112191/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 07:06:59,593 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 07:06:59,594 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1690009603047.560632f569d6e50548da13fc81ec6164. 2023-07-22 07:06:59,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 560632f569d6e50548da13fc81ec6164: 2023-07-22 07:06:59,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 07:06:59,596 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1690009603047.151e7930118d1b96fb5972fc3a112191. 2023-07-22 07:06:59,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 151e7930118d1b96fb5972fc3a112191: 2023-07-22 07:06:59,597 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 560632f569d6e50548da13fc81ec6164 2023-07-22 07:06:59,598 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=560632f569d6e50548da13fc81ec6164, regionState=CLOSED 2023-07-22 07:06:59,598 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1690009603047.560632f569d6e50548da13fc81ec6164.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690009619598"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690009619598"}]},"ts":"1690009619598"} 2023-07-22 07:06:59,598 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 151e7930118d1b96fb5972fc3a112191 2023-07-22 07:06:59,599 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=151e7930118d1b96fb5972fc3a112191, regionState=CLOSED 2023-07-22 07:06:59,599 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1690009603047.151e7930118d1b96fb5972fc3a112191.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690009619599"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690009619599"}]},"ts":"1690009619599"} 2023-07-22 07:06:59,602 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-22 07:06:59,602 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 560632f569d6e50548da13fc81ec6164, server=jenkins-hbase4.apache.org,34707,1690009574173 in 176 msec 2023-07-22 07:06:59,604 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-22 07:06:59,604 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 151e7930118d1b96fb5972fc3a112191, server=jenkins-hbase4.apache.org,43271,1690009574333 in 178 msec 2023-07-22 07:06:59,605 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=560632f569d6e50548da13fc81ec6164, UNASSIGN in 195 msec 2023-07-22 07:06:59,606 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-22 07:06:59,606 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=151e7930118d1b96fb5972fc3a112191, UNASSIGN in 197 msec 2023-07-22 07:06:59,607 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690009619607"}]},"ts":"1690009619607"} 2023-07-22 07:06:59,608 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-22 07:06:59,611 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-22 07:06:59,613 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 219 msec 2023-07-22 07:06:59,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-22 07:06:59,703 INFO [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-22 07:06:59,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-22 07:06:59,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-22 07:06:59,708 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-22 07:06:59,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-22 07:06:59,709 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-22 07:06:59,711 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44269] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-22 07:06:59,713 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 07:06:59,713 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 07:06:59,713 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 07:06:59,714 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 07:06:59,714 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-22 07:06:59,714 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-22 07:06:59,714 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-22 07:06:59,714 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-22 07:06:59,715 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemState/560632f569d6e50548da13fc81ec6164 2023-07-22 07:06:59,715 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 07:06:59,715 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 07:06:59,715 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:06:59,716 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 07:06:59,716 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:06:59,716 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 07:06:59,716 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:06:59,716 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:06:59,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-22 07:06:59,718 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemState/151e7930118d1b96fb5972fc3a112191 2023-07-22 07:06:59,720 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemState/560632f569d6e50548da13fc81ec6164/cf, FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemState/560632f569d6e50548da13fc81ec6164/recovered.edits] 2023-07-22 07:06:59,720 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemState/151e7930118d1b96fb5972fc3a112191/cf, FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemState/151e7930118d1b96fb5972fc3a112191/recovered.edits] 2023-07-22 07:06:59,725 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemState/560632f569d6e50548da13fc81ec6164/cf/cab08a13805d4605aa5d131e91f1836a to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/archive/data/default/testtb-testExportFileSystemState/560632f569d6e50548da13fc81ec6164/cf/cab08a13805d4605aa5d131e91f1836a 2023-07-22 07:06:59,725 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemState/151e7930118d1b96fb5972fc3a112191/cf/0bef68e109c84e08950d8cb2bc7870fa to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/archive/data/default/testtb-testExportFileSystemState/151e7930118d1b96fb5972fc3a112191/cf/0bef68e109c84e08950d8cb2bc7870fa 2023-07-22 07:06:59,728 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemState/560632f569d6e50548da13fc81ec6164/recovered.edits/9.seqid to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/archive/data/default/testtb-testExportFileSystemState/560632f569d6e50548da13fc81ec6164/recovered.edits/9.seqid 2023-07-22 07:06:59,728 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemState/151e7930118d1b96fb5972fc3a112191/recovered.edits/9.seqid to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/archive/data/default/testtb-testExportFileSystemState/151e7930118d1b96fb5972fc3a112191/recovered.edits/9.seqid 2023-07-22 07:06:59,729 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemState/560632f569d6e50548da13fc81ec6164 2023-07-22 07:06:59,729 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemState/151e7930118d1b96fb5972fc3a112191 2023-07-22 07:06:59,729 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-22 07:06:59,729 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-22 07:06:59,730 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-22 07:06:59,733 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230722de1c7cf002774c728f41d497d7dded0f to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230722de1c7cf002774c728f41d497d7dded0f 2023-07-22 07:06:59,734 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023072244984750d9294cf8b92bf2628703985b to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023072244984750d9294cf8b92bf2628703985b 2023-07-22 07:06:59,735 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-22 07:06:59,737 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-22 07:06:59,739 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-22 07:06:59,742 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-22 07:06:59,744 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-22 07:06:59,745 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-22 07:06:59,745 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1690009603047.560632f569d6e50548da13fc81ec6164.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690009619745"}]},"ts":"9223372036854775807"} 2023-07-22 07:06:59,745 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1690009603047.151e7930118d1b96fb5972fc3a112191.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690009619745"}]},"ts":"9223372036854775807"} 2023-07-22 07:06:59,747 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-22 07:06:59,747 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 560632f569d6e50548da13fc81ec6164, NAME => 'testtb-testExportFileSystemState,,1690009603047.560632f569d6e50548da13fc81ec6164.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 151e7930118d1b96fb5972fc3a112191, NAME => 'testtb-testExportFileSystemState,1,1690009603047.151e7930118d1b96fb5972fc3a112191.', STARTKEY => '1', ENDKEY => ''}] 2023-07-22 07:06:59,747 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-22 07:06:59,747 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690009619747"}]},"ts":"9223372036854775807"} 2023-07-22 07:06:59,749 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-22 07:06:59,753 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-22 07:06:59,755 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 49 msec 2023-07-22 07:06:59,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-22 07:06:59,819 INFO [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-22 07:06:59,826 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-22 07:06:59,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-22 07:06:59,830 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-22 07:06:59,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-22 07:06:59,856 INFO [Listener at jenkins-hbase4.apache.org/45401] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=762 (was 755) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1471300812_1 at /127.0.0.1:56804 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6ff205ea-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2149 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_663023864_17 at /127.0.0.1:56820 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_663023864_17 at /127.0.0.1:40984 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1471300812_1 at /127.0.0.1:44362 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1203180535) connection to jenkins-hbase4.apache.org/172.31.14.131:43251 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6ff205ea-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6ff205ea-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6ff205ea-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=918 (was 936), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=326 (was 376), ProcessCount=179 (was 179), AvailableMemoryMB=6471 (was 6640) 2023-07-22 07:06:59,856 WARN [Listener at jenkins-hbase4.apache.org/45401] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-22 07:06:59,876 INFO [Listener at jenkins-hbase4.apache.org/45401] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=762, OpenFileDescriptor=918, MaxFileDescriptor=60000, SystemLoadAverage=326, ProcessCount=179, AvailableMemoryMB=6470 2023-07-22 07:06:59,876 WARN [Listener at jenkins-hbase4.apache.org/45401] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-22 07:06:59,878 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-22 07:06:59,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-22 07:06:59,881 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 07:06:59,881 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-22 07:06:59,882 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 07:06:59,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-22 07:06:59,885 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testConsecutiveExports/89c85a382f3b774d9d841c6defbe2f66 2023-07-22 07:06:59,885 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testConsecutiveExports/a524a7c5b080e67489b8e32f2106ab69 2023-07-22 07:06:59,885 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testConsecutiveExports/89c85a382f3b774d9d841c6defbe2f66 empty. 2023-07-22 07:06:59,885 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testConsecutiveExports/a524a7c5b080e67489b8e32f2106ab69 empty. 2023-07-22 07:06:59,886 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testConsecutiveExports/89c85a382f3b774d9d841c6defbe2f66 2023-07-22 07:06:59,886 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testConsecutiveExports/a524a7c5b080e67489b8e32f2106ab69 2023-07-22 07:06:59,886 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-22 07:06:59,899 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-22 07:06:59,901 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 89c85a382f3b774d9d841c6defbe2f66, NAME => 'testtb-testConsecutiveExports,,1690009619877.89c85a382f3b774d9d841c6defbe2f66.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp 2023-07-22 07:06:59,901 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => a524a7c5b080e67489b8e32f2106ab69, NAME => 'testtb-testConsecutiveExports,1,1690009619877.a524a7c5b080e67489b8e32f2106ab69.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp 2023-07-22 07:06:59,915 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1690009619877.89c85a382f3b774d9d841c6defbe2f66.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 07:06:59,915 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 89c85a382f3b774d9d841c6defbe2f66, disabling compactions & flushes 2023-07-22 07:06:59,915 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1690009619877.89c85a382f3b774d9d841c6defbe2f66. 2023-07-22 07:06:59,915 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1690009619877.89c85a382f3b774d9d841c6defbe2f66. 2023-07-22 07:06:59,915 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1690009619877.a524a7c5b080e67489b8e32f2106ab69.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 07:06:59,915 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1690009619877.89c85a382f3b774d9d841c6defbe2f66. after waiting 0 ms 2023-07-22 07:06:59,915 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing a524a7c5b080e67489b8e32f2106ab69, disabling compactions & flushes 2023-07-22 07:06:59,915 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1690009619877.89c85a382f3b774d9d841c6defbe2f66. 2023-07-22 07:06:59,915 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1690009619877.a524a7c5b080e67489b8e32f2106ab69. 2023-07-22 07:06:59,915 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1690009619877.89c85a382f3b774d9d841c6defbe2f66. 2023-07-22 07:06:59,915 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1690009619877.a524a7c5b080e67489b8e32f2106ab69. 2023-07-22 07:06:59,915 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 89c85a382f3b774d9d841c6defbe2f66: 2023-07-22 07:06:59,915 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1690009619877.a524a7c5b080e67489b8e32f2106ab69. after waiting 0 ms 2023-07-22 07:06:59,915 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1690009619877.a524a7c5b080e67489b8e32f2106ab69. 2023-07-22 07:06:59,915 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1690009619877.a524a7c5b080e67489b8e32f2106ab69. 2023-07-22 07:06:59,915 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for a524a7c5b080e67489b8e32f2106ab69: 2023-07-22 07:06:59,920 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 07:06:59,922 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1690009619877.89c85a382f3b774d9d841c6defbe2f66.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690009619921"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690009619921"}]},"ts":"1690009619921"} 2023-07-22 07:06:59,922 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1690009619877.a524a7c5b080e67489b8e32f2106ab69.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690009619921"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690009619921"}]},"ts":"1690009619921"} 2023-07-22 07:06:59,925 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-22 07:06:59,927 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 07:06:59,927 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690009619927"}]},"ts":"1690009619927"} 2023-07-22 07:06:59,928 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-22 07:06:59,932 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 07:06:59,933 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 07:06:59,933 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 07:06:59,933 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 07:06:59,933 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 07:06:59,934 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=89c85a382f3b774d9d841c6defbe2f66, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a524a7c5b080e67489b8e32f2106ab69, ASSIGN}] 2023-07-22 07:06:59,937 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a524a7c5b080e67489b8e32f2106ab69, ASSIGN 2023-07-22 07:06:59,937 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=89c85a382f3b774d9d841c6defbe2f66, ASSIGN 2023-07-22 07:06:59,938 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a524a7c5b080e67489b8e32f2106ab69, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34707,1690009574173; forceNewPlan=false, retain=false 2023-07-22 07:06:59,939 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=89c85a382f3b774d9d841c6defbe2f66, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44269,1690009574260; forceNewPlan=false, retain=false 2023-07-22 07:06:59,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-22 07:07:00,088 INFO [jenkins-hbase4:44609] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-22 07:07:00,092 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=a524a7c5b080e67489b8e32f2106ab69, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:00,092 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=89c85a382f3b774d9d841c6defbe2f66, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:00,092 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1690009619877.a524a7c5b080e67489b8e32f2106ab69.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690009620091"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690009620091"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690009620091"}]},"ts":"1690009620091"} 2023-07-22 07:07:00,092 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1690009619877.89c85a382f3b774d9d841c6defbe2f66.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690009620091"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690009620091"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690009620091"}]},"ts":"1690009620091"} 2023-07-22 07:07:00,094 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure a524a7c5b080e67489b8e32f2106ab69, server=jenkins-hbase4.apache.org,34707,1690009574173}] 2023-07-22 07:07:00,096 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 89c85a382f3b774d9d841c6defbe2f66, server=jenkins-hbase4.apache.org,44269,1690009574260}] 2023-07-22 07:07:00,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-22 07:07:00,253 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1690009619877.a524a7c5b080e67489b8e32f2106ab69. 2023-07-22 07:07:00,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a524a7c5b080e67489b8e32f2106ab69, NAME => 'testtb-testConsecutiveExports,1,1690009619877.a524a7c5b080e67489b8e32f2106ab69.', STARTKEY => '1', ENDKEY => ''} 2023-07-22 07:07:00,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1690009619877.a524a7c5b080e67489b8e32f2106ab69. service=AccessControlService 2023-07-22 07:07:00,253 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 07:07:00,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports a524a7c5b080e67489b8e32f2106ab69 2023-07-22 07:07:00,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1690009619877.a524a7c5b080e67489b8e32f2106ab69.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 07:07:00,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a524a7c5b080e67489b8e32f2106ab69 2023-07-22 07:07:00,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a524a7c5b080e67489b8e32f2106ab69 2023-07-22 07:07:00,259 INFO [StoreOpener-a524a7c5b080e67489b8e32f2106ab69-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a524a7c5b080e67489b8e32f2106ab69 2023-07-22 07:07:00,259 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1690009619877.89c85a382f3b774d9d841c6defbe2f66. 2023-07-22 07:07:00,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 89c85a382f3b774d9d841c6defbe2f66, NAME => 'testtb-testConsecutiveExports,,1690009619877.89c85a382f3b774d9d841c6defbe2f66.', STARTKEY => '', ENDKEY => '1'} 2023-07-22 07:07:00,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1690009619877.89c85a382f3b774d9d841c6defbe2f66. service=AccessControlService 2023-07-22 07:07:00,260 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 07:07:00,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 89c85a382f3b774d9d841c6defbe2f66 2023-07-22 07:07:00,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1690009619877.89c85a382f3b774d9d841c6defbe2f66.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 07:07:00,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 89c85a382f3b774d9d841c6defbe2f66 2023-07-22 07:07:00,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 89c85a382f3b774d9d841c6defbe2f66 2023-07-22 07:07:00,262 DEBUG [StoreOpener-a524a7c5b080e67489b8e32f2106ab69-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testConsecutiveExports/a524a7c5b080e67489b8e32f2106ab69/cf 2023-07-22 07:07:00,262 DEBUG [StoreOpener-a524a7c5b080e67489b8e32f2106ab69-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testConsecutiveExports/a524a7c5b080e67489b8e32f2106ab69/cf 2023-07-22 07:07:00,262 INFO [StoreOpener-89c85a382f3b774d9d841c6defbe2f66-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 89c85a382f3b774d9d841c6defbe2f66 2023-07-22 07:07:00,262 INFO [StoreOpener-a524a7c5b080e67489b8e32f2106ab69-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a524a7c5b080e67489b8e32f2106ab69 columnFamilyName cf 2023-07-22 07:07:00,264 DEBUG [StoreOpener-89c85a382f3b774d9d841c6defbe2f66-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testConsecutiveExports/89c85a382f3b774d9d841c6defbe2f66/cf 2023-07-22 07:07:00,264 DEBUG [StoreOpener-89c85a382f3b774d9d841c6defbe2f66-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testConsecutiveExports/89c85a382f3b774d9d841c6defbe2f66/cf 2023-07-22 07:07:00,264 INFO [StoreOpener-a524a7c5b080e67489b8e32f2106ab69-1] regionserver.HStore(310): Store=a524a7c5b080e67489b8e32f2106ab69/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 07:07:00,264 INFO [StoreOpener-89c85a382f3b774d9d841c6defbe2f66-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 89c85a382f3b774d9d841c6defbe2f66 columnFamilyName cf 2023-07-22 07:07:00,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testConsecutiveExports/a524a7c5b080e67489b8e32f2106ab69 2023-07-22 07:07:00,265 INFO [StoreOpener-89c85a382f3b774d9d841c6defbe2f66-1] regionserver.HStore(310): Store=89c85a382f3b774d9d841c6defbe2f66/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 07:07:00,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testConsecutiveExports/a524a7c5b080e67489b8e32f2106ab69 2023-07-22 07:07:00,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testConsecutiveExports/89c85a382f3b774d9d841c6defbe2f66 2023-07-22 07:07:00,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testConsecutiveExports/89c85a382f3b774d9d841c6defbe2f66 2023-07-22 07:07:00,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a524a7c5b080e67489b8e32f2106ab69 2023-07-22 07:07:00,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 89c85a382f3b774d9d841c6defbe2f66 2023-07-22 07:07:00,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testConsecutiveExports/a524a7c5b080e67489b8e32f2106ab69/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 07:07:00,272 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a524a7c5b080e67489b8e32f2106ab69; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71628379, jitterRate=0.06734602153301239}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 07:07:00,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a524a7c5b080e67489b8e32f2106ab69: 2023-07-22 07:07:00,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testConsecutiveExports/89c85a382f3b774d9d841c6defbe2f66/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 07:07:00,273 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1690009619877.a524a7c5b080e67489b8e32f2106ab69., pid=45, masterSystemTime=1690009620247 2023-07-22 07:07:00,273 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 89c85a382f3b774d9d841c6defbe2f66; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64114844, jitterRate=-0.04461437463760376}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 07:07:00,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 89c85a382f3b774d9d841c6defbe2f66: 2023-07-22 07:07:00,274 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1690009619877.89c85a382f3b774d9d841c6defbe2f66., pid=46, masterSystemTime=1690009620250 2023-07-22 07:07:00,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1690009619877.a524a7c5b080e67489b8e32f2106ab69. 2023-07-22 07:07:00,276 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1690009619877.a524a7c5b080e67489b8e32f2106ab69. 2023-07-22 07:07:00,277 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=a524a7c5b080e67489b8e32f2106ab69, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:00,277 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1690009619877.a524a7c5b080e67489b8e32f2106ab69.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690009620277"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690009620277"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690009620277"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690009620277"}]},"ts":"1690009620277"} 2023-07-22 07:07:00,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1690009619877.89c85a382f3b774d9d841c6defbe2f66. 2023-07-22 07:07:00,278 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1690009619877.89c85a382f3b774d9d841c6defbe2f66. 2023-07-22 07:07:00,279 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=89c85a382f3b774d9d841c6defbe2f66, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:00,279 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1690009619877.89c85a382f3b774d9d841c6defbe2f66.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690009620279"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690009620279"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690009620279"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690009620279"}]},"ts":"1690009620279"} 2023-07-22 07:07:00,285 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-22 07:07:00,285 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-22 07:07:00,285 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure a524a7c5b080e67489b8e32f2106ab69, server=jenkins-hbase4.apache.org,34707,1690009574173 in 186 msec 2023-07-22 07:07:00,285 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 89c85a382f3b774d9d841c6defbe2f66, server=jenkins-hbase4.apache.org,44269,1690009574260 in 187 msec 2023-07-22 07:07:00,287 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=89c85a382f3b774d9d841c6defbe2f66, ASSIGN in 351 msec 2023-07-22 07:07:00,288 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-22 07:07:00,289 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a524a7c5b080e67489b8e32f2106ab69, ASSIGN in 352 msec 2023-07-22 07:07:00,289 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 07:07:00,290 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690009620289"}]},"ts":"1690009620289"} 2023-07-22 07:07:00,291 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-22 07:07:00,300 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 07:07:00,300 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-22 07:07:00,302 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44269] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-22 07:07:00,304 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:07:00,304 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:07:00,304 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:07:00,304 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:07:00,305 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-22 07:07:00,306 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-22 07:07:00,306 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-22 07:07:00,306 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-22 07:07:00,312 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 428 msec 2023-07-22 07:07:00,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-22 07:07:00,486 INFO [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-22 07:07:00,489 DEBUG [Listener at jenkins-hbase4.apache.org/45401] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-22 07:07:00,489 DEBUG [Listener at jenkins-hbase4.apache.org/45401] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1690009619877.89c85a382f3b774d9d841c6defbe2f66. 2023-07-22 07:07:00,491 INFO [Listener at jenkins-hbase4.apache.org/45401] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 07:07:00,498 DEBUG [hconnection-0x430a1db4-shared-pool-16] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 07:07:00,502 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60662, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 07:07:00,507 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-22 07:07:00,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690009620507 (current time:1690009620507). 2023-07-22 07:07:00,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 07:07:00,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(139): Connect 0x1bc97a9c to 127.0.0.1:63277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 07:07:00,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70d3858b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 07:07:00,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 07:07:00,516 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52206, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 07:07:00,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1bc97a9c to 127.0.0.1:63277 2023-07-22 07:07:00,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 07:07:00,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(139): Connect 0x2fd9a49e to 127.0.0.1:63277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 07:07:00,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f943663, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 07:07:00,524 DEBUG [hconnection-0x13070bc7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 07:07:00,526 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52218, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 07:07:00,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 07:07:00,533 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60676, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 07:07:00,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2fd9a49e to 127.0.0.1:63277 2023-07-22 07:07:00,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 07:07:00,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-22 07:07:00,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 07:07:00,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-22 07:07:00,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-22 07:07:00,539 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-22 07:07:00,540 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1690010220540 2023-07-22 07:07:00,540 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-22 07:07:00,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-22 07:07:00,541 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 07:07:00,542 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 07:07:00,542 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-22 07:07:00,545 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-22 07:07:00,547 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 8 msec 2023-07-22 07:07:00,548 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-22 07:07:00,549 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1690010220549 2023-07-22 07:07:00,560 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,560 INFO [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-22 07:07:00,560 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:07:00,561 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-22 07:07:00,561 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-22 07:07:00,562 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,562 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,563 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:07:00,563 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:07:00,563 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:07:00,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:07:00,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:07:00,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:07:00,563 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:00,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:07:00,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:07:00,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:07:00,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,564 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:00,564 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:00,564 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,565 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,565 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-22 07:07:00,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-22 07:07:00,565 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:00,565 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-22 07:07:00,565 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 07:07:00,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-22 07:07:00,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,566 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-22 07:07:00,566 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-22 07:07:00,566 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,566 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-22 07:07:00,566 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,566 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:07:00,566 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-22 07:07:00,568 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-22 07:07:00,568 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:07:00,566 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,569 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-22 07:07:00,569 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-22 07:07:00,568 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-22 07:07:00,569 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:07:00,569 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-22 07:07:00,572 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-22 07:07:00,572 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-22 07:07:00,569 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43271,1690009574333' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-22 07:07:00,572 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34707,1690009574173' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-22 07:07:00,572 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44269,1690009574260' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-22 07:07:00,574 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:00,574 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:00,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:07:00,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:07:00,574 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,575 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:00,575 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,575 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,575 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 07:07:00,575 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:07:00,575 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 07:07:00,575 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,575 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 07:07:00,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:07:00,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:00,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:00,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:00,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:07:00,577 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34707,1690009574173' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-22 07:07:00,577 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a8dd33d[Count = 1] remaining members to acquire global barrier 2023-07-22 07:07:00,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:00,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:07:00,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:07:00,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:07:00,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:07:00,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:00,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:00,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:00,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:07:00,580 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44269,1690009574260' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-22 07:07:00,580 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a8dd33d[Count = 0] remaining members to acquire global barrier 2023-07-22 07:07:00,580 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-22 07:07:00,580 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,582 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,582 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,582 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,582 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-22 07:07:00,582 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:00,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,582 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-22 07:07:00,582 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-22 07:07:00,582 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43271,1690009574333' in zk 2023-07-22 07:07:00,582 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:00,582 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 07:07:00,582 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1690009619877.89c85a382f3b774d9d841c6defbe2f66. 2023-07-22 07:07:00,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,583 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1690009619877.89c85a382f3b774d9d841c6defbe2f66. started... 2023-07-22 07:07:00,583 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-22 07:07:00,582 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 07:07:00,583 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 07:07:00,583 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 07:07:00,583 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 89c85a382f3b774d9d841c6defbe2f66: 2023-07-22 07:07:00,583 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1690009619877.a524a7c5b080e67489b8e32f2106ab69. 2023-07-22 07:07:00,583 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 07:07:00,583 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1690009619877.89c85a382f3b774d9d841c6defbe2f66.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,583 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1690009619877.a524a7c5b080e67489b8e32f2106ab69. started... 2023-07-22 07:07:00,583 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 07:07:00,583 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 07:07:00,584 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a524a7c5b080e67489b8e32f2106ab69: 2023-07-22 07:07:00,585 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1690009619877.a524a7c5b080e67489b8e32f2106ab69.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,585 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 07:07:00,585 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 07:07:00,587 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-22 07:07:00,587 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:07:00,587 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-22 07:07:00,594 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1690009619877.89c85a382f3b774d9d841c6defbe2f66. completed. 2023-07-22 07:07:00,594 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1690009619877.89c85a382f3b774d9d841c6defbe2f66. 2023-07-22 07:07:00,594 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 07:07:00,594 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 07:07:00,594 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:00,594 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1690009619877.a524a7c5b080e67489b8e32f2106ab69. completed. 2023-07-22 07:07:00,594 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-22 07:07:00,594 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44269,1690009574260' in zk 2023-07-22 07:07:00,594 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1690009619877.a524a7c5b080e67489b8e32f2106ab69. 2023-07-22 07:07:00,594 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 07:07:00,594 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 07:07:00,594 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:00,595 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-22 07:07:00,595 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34707,1690009574173' in zk 2023-07-22 07:07:00,596 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-22 07:07:00,596 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:00,596 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:07:00,596 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-22 07:07:00,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:00,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:07:00,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:07:00,597 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:00,597 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-22 07:07:00,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:07:00,597 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:07:00,597 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-22 07:07:00,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:07:00,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:00,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:00,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:00,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:07:00,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:00,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:00,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:00,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,44269,1690009574260': 2023-07-22 07:07:00,601 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44269,1690009574260' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-22 07:07:00,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:00,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:07:00,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:07:00,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:07:00,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:07:00,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:00,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:00,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:00,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:07:00,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:00,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:00,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:00,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34707,1690009574173': 2023-07-22 07:07:00,605 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34707,1690009574173' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-22 07:07:00,605 INFO [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-22 07:07:00,605 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 07:07:00,605 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 07:07:00,605 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,605 INFO [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 07:07:00,606 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,606 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,606 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:07:00,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:07:00,606 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:07:00,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,606 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,606 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:07:00,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:07:00,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:07:00,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:07:00,607 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:00,607 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:07:00,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:07:00,608 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:00,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:07:00,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:07:00,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:07:00,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:07:00,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,609 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:00,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:00,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:00,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:00,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:07:00,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:00,610 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:00,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:00,611 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:00,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:00,611 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:00,614 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:00,614 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,614 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:07:00,614 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:07:00,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:07:00,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:07:00,614 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:00,614 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:07:00,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:07:00,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:07:00,614 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:07:00,614 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:07:00,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:07:00,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:07:00,614 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:07:00,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:07:00,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:07:00,614 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,614 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:00,616 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-22 07:07:00,616 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:07:00,616 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:07:00,616 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-22 07:07:00,615 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:07:00,616 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:00,616 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,616 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:00,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:07:00,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:07:00,616 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:00,617 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,617 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,617 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-22 07:07:00,625 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,626 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,641 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,642 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 07:07:00,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-22 07:07:00,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-22 07:07:00,643 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 07:07:00,666 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-22 07:07:00,666 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,667 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:00,667 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1690009620540Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1690009620625 (+85 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1690009620625Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1690009620625Writing data manifest for emptySnaptb0-testConsecutiveExports at 1690009620628 (+3 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1690009620636 (+8 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1690009620666 (+30 ms) 2023-07-22 07:07:00,670 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-22 07:07:00,672 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 129 msec 2023-07-22 07:07:00,843 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 07:07:00,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-22 07:07:00,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 07:07:00,847 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44269] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1690009619877.89c85a382f3b774d9d841c6defbe2f66. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 07:07:00,849 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34707] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1690009619877.a524a7c5b080e67489b8e32f2106ab69. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 07:07:00,852 DEBUG [Listener at jenkins-hbase4.apache.org/45401] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-22 07:07:00,852 DEBUG [Listener at jenkins-hbase4.apache.org/45401] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1690009619877.89c85a382f3b774d9d841c6defbe2f66. 2023-07-22 07:07:00,853 INFO [Listener at jenkins-hbase4.apache.org/45401] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 07:07:00,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-22 07:07:00,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690009620864 (current time:1690009620864). 2023-07-22 07:07:00,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 07:07:00,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(139): Connect 0x2d7b59cc to 127.0.0.1:63277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 07:07:00,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@85da479, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 07:07:00,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 07:07:00,884 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52226, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 07:07:00,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2d7b59cc to 127.0.0.1:63277 2023-07-22 07:07:00,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 07:07:00,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(139): Connect 0x30fc1640 to 127.0.0.1:63277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 07:07:00,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@473e9caa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 07:07:00,901 DEBUG [hconnection-0x22a58658-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 07:07:00,902 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52232, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 07:07:00,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 07:07:00,907 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60690, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 07:07:00,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x30fc1640 to 127.0.0.1:63277 2023-07-22 07:07:00,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 07:07:00,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-22 07:07:00,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 07:07:00,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-22 07:07:00,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-22 07:07:00,913 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-22 07:07:00,914 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1690010220914 2023-07-22 07:07:00,914 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-22 07:07:00,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-22 07:07:00,916 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 07:07:00,916 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 07:07:00,917 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-22 07:07:00,918 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-22 07:07:00,919 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-07-22 07:07:00,920 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-22 07:07:00,921 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1690010220921 2023-07-22 07:07:00,939 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-22 07:07:00,939 INFO [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-22 07:07:00,939 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:07:00,941 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-22 07:07:00,941 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-22 07:07:00,941 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 07:07:00,941 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 07:07:00,943 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:07:00,943 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:07:00,943 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:07:00,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:07:00,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:07:00,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:07:00,943 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:00,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:07:00,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:07:00,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:07:00,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 07:07:00,943 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:00,944 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:00,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 07:07:00,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 07:07:00,944 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 07:07:00,944 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 07:07:00,944 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 07:07:00,944 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:00,944 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 07:07:00,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-22 07:07:00,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-22 07:07:00,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 07:07:00,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 07:07:00,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-22 07:07:00,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 07:07:00,945 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-22 07:07:00,945 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-22 07:07:00,945 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-22 07:07:00,945 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-22 07:07:00,945 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-22 07:07:00,945 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-22 07:07:00,945 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-22 07:07:00,945 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-22 07:07:00,945 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:07:00,945 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-22 07:07:00,945 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:07:00,947 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:07:00,947 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-22 07:07:00,949 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-22 07:07:00,950 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-22 07:07:00,948 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-22 07:07:00,950 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43271,1690009574333' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-22 07:07:00,949 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-22 07:07:00,950 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-22 07:07:00,950 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34707,1690009574173' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-22 07:07:00,950 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44269,1690009574260' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-22 07:07:00,952 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 07:07:00,952 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:00,952 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 07:07:00,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:00,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:07:00,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:07:00,953 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:00,953 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 07:07:00,953 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 07:07:00,953 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 07:07:00,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:07:00,953 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 07:07:00,953 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 07:07:00,953 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 07:07:00,953 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 07:07:00,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:07:00,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 07:07:00,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:00,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:00,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:00,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:07:00,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34707,1690009574173' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-22 07:07:00,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38e615b1[Count = 1] remaining members to acquire global barrier 2023-07-22 07:07:00,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:00,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:07:00,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:07:00,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:07:00,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:07:00,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 07:07:00,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:00,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:00,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:00,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:07:00,957 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44269,1690009574260' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-22 07:07:00,957 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38e615b1[Count = 0] remaining members to acquire global barrier 2023-07-22 07:07:00,957 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-22 07:07:00,957 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 07:07:00,958 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 07:07:00,958 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 07:07:00,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 07:07:00,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 07:07:00,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 07:07:00,958 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 07:07:00,959 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-22 07:07:00,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 07:07:00,959 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:00,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 07:07:00,959 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 07:07:00,959 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-22 07:07:00,959 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-22 07:07:00,959 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43271,1690009574333' in zk 2023-07-22 07:07:00,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 07:07:00,959 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1690009619877.a524a7c5b080e67489b8e32f2106ab69. 2023-07-22 07:07:00,959 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 07:07:00,959 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1690009619877.a524a7c5b080e67489b8e32f2106ab69. started... 2023-07-22 07:07:00,959 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-22 07:07:00,959 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:00,959 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 07:07:00,959 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 07:07:00,959 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 07:07:00,960 INFO [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a524a7c5b080e67489b8e32f2106ab69 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-22 07:07:00,960 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1690009619877.89c85a382f3b774d9d841c6defbe2f66. 2023-07-22 07:07:00,960 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1690009619877.89c85a382f3b774d9d841c6defbe2f66. started... 2023-07-22 07:07:00,960 INFO [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 89c85a382f3b774d9d841c6defbe2f66 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-22 07:07:00,960 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-22 07:07:00,961 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:07:00,961 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-22 07:07:00,999 INFO [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230722af5d69eb1e8d4f3b85b9eb6ebd1d1111 to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230722af5d69eb1e8d4f3b85b9eb6ebd1d1111 2023-07-22 07:07:01,000 INFO [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230722c3cee3c29cae4b5ab7ce919c2f414fd8 to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230722c3cee3c29cae4b5ab7ce919c2f414fd8 2023-07-22 07:07:01,014 INFO [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testConsecutiveExports/a524a7c5b080e67489b8e32f2106ab69/.tmp/cf/90b7df533f8e4aaca1b73f13a3cc7077 2023-07-22 07:07:01,016 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 07:07:01,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-22 07:07:01,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-22 07:07:01,018 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 07:07:01,021 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testConsecutiveExports/a524a7c5b080e67489b8e32f2106ab69/.tmp/cf/90b7df533f8e4aaca1b73f13a3cc7077 as hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testConsecutiveExports/a524a7c5b080e67489b8e32f2106ab69/cf/90b7df533f8e4aaca1b73f13a3cc7077 2023-07-22 07:07:01,027 INFO [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testConsecutiveExports/a524a7c5b080e67489b8e32f2106ab69/cf/90b7df533f8e4aaca1b73f13a3cc7077, entries=47, sequenceid=6, filesize=12.7 K 2023-07-22 07:07:01,028 INFO [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for a524a7c5b080e67489b8e32f2106ab69 in 69ms, sequenceid=6, compaction requested=false 2023-07-22 07:07:01,028 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-22 07:07:01,028 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a524a7c5b080e67489b8e32f2106ab69: 2023-07-22 07:07:01,029 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1690009619877.a524a7c5b080e67489b8e32f2106ab69.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-22 07:07:01,029 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 07:07:01,029 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testConsecutiveExports/a524a7c5b080e67489b8e32f2106ab69/cf/90b7df533f8e4aaca1b73f13a3cc7077] hfiles 2023-07-22 07:07:01,029 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testConsecutiveExports/a524a7c5b080e67489b8e32f2106ab69/cf/90b7df533f8e4aaca1b73f13a3cc7077 for snapshot=snaptb0-testConsecutiveExports 2023-07-22 07:07:01,031 INFO [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testConsecutiveExports/89c85a382f3b774d9d841c6defbe2f66/.tmp/cf/e215b21220c7485fb155a228a0ce7a01 2023-07-22 07:07:01,038 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testConsecutiveExports/89c85a382f3b774d9d841c6defbe2f66/.tmp/cf/e215b21220c7485fb155a228a0ce7a01 as hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testConsecutiveExports/89c85a382f3b774d9d841c6defbe2f66/cf/e215b21220c7485fb155a228a0ce7a01 2023-07-22 07:07:01,045 INFO [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testConsecutiveExports/89c85a382f3b774d9d841c6defbe2f66/cf/e215b21220c7485fb155a228a0ce7a01, entries=3, sequenceid=6, filesize=5.4 K 2023-07-22 07:07:01,046 INFO [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 89c85a382f3b774d9d841c6defbe2f66 in 86ms, sequenceid=6, compaction requested=false 2023-07-22 07:07:01,048 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 89c85a382f3b774d9d841c6defbe2f66: 2023-07-22 07:07:01,049 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1690009619877.89c85a382f3b774d9d841c6defbe2f66.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-22 07:07:01,049 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 07:07:01,049 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testConsecutiveExports/89c85a382f3b774d9d841c6defbe2f66/cf/e215b21220c7485fb155a228a0ce7a01] hfiles 2023-07-22 07:07:01,049 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testConsecutiveExports/89c85a382f3b774d9d841c6defbe2f66/cf/e215b21220c7485fb155a228a0ce7a01 for snapshot=snaptb0-testConsecutiveExports 2023-07-22 07:07:01,055 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1690009619877.a524a7c5b080e67489b8e32f2106ab69. completed. 2023-07-22 07:07:01,055 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1690009619877.a524a7c5b080e67489b8e32f2106ab69. 2023-07-22 07:07:01,055 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 07:07:01,055 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 07:07:01,055 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:01,055 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-22 07:07:01,055 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34707,1690009574173' in zk 2023-07-22 07:07:01,062 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:01,062 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-22 07:07:01,062 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:07:01,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:01,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:07:01,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:07:01,062 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-22 07:07:01,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:07:01,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:07:01,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 07:07:01,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:01,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:01,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:01,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:07:01,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 07:07:01,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:01,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:01,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34707,1690009574173': 2023-07-22 07:07:01,069 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34707,1690009574173' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-22 07:07:01,070 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1690009619877.89c85a382f3b774d9d841c6defbe2f66. completed. 2023-07-22 07:07:01,070 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1690009619877.89c85a382f3b774d9d841c6defbe2f66. 2023-07-22 07:07:01,070 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 07:07:01,070 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 07:07:01,070 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:01,070 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-22 07:07:01,070 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44269,1690009574260' in zk 2023-07-22 07:07:01,072 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-22 07:07:01,072 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:01,072 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:07:01,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:01,072 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-22 07:07:01,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:07:01,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:07:01,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:07:01,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:07:01,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 07:07:01,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:01,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:01,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:01,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:07:01,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 07:07:01,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:01,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:01,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:01,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,44269,1690009574260': 2023-07-22 07:07:01,077 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44269,1690009574260' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-22 07:07:01,077 INFO [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-22 07:07:01,077 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 07:07:01,078 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 07:07:01,078 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-22 07:07:01,078 INFO [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 07:07:01,079 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 07:07:01,079 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 07:07:01,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 07:07:01,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 07:07:01,079 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:07:01,080 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 07:07:01,080 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:07:01,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 07:07:01,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:07:01,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:07:01,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 07:07:01,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 07:07:01,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:07:01,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:07:01,080 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:01,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:07:01,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:07:01,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 07:07:01,080 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:01,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:07:01,081 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 07:07:01,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 07:07:01,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 07:07:01,081 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:07:01,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 07:07:01,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 07:07:01,081 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:01,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:07:01,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:07:01,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 07:07:01,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:07:01,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 07:07:01,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:01,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:01,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:01,084 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:01,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:07:01,084 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:01,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 07:07:01,085 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:01,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:01,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:01,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:01,093 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:07:01,093 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:01,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:07:01,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:07:01,093 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:07:01,093 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 07:07:01,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:07:01,093 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-22 07:07:01,093 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:01,093 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-22 07:07:01,093 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:07:01,093 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:07:01,093 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-22 07:07:01,093 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:01,093 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:07:01,093 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:07:01,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:07:01,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:07:01,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:07:01,095 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 07:07:01,095 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-22 07:07:01,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:07:01,093 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:07:01,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:07:01,095 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:01,096 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 07:07:01,096 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:01,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:07:01,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:07:01,096 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:01,096 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 07:07:01,096 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 07:07:01,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:07:01,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:07:01,097 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230722af5d69eb1e8d4f3b85b9eb6ebd1d1111, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230722c3cee3c29cae4b5ab7ce919c2f414fd8] mob files 2023-07-22 07:07:01,097 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230722af5d69eb1e8d4f3b85b9eb6ebd1d1111 2023-07-22 07:07:01,097 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230722c3cee3c29cae4b5ab7ce919c2f414fd8 2023-07-22 07:07:01,104 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-22 07:07:01,105 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-22 07:07:01,137 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-22 07:07:01,164 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-22 07:07:01,164 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-22 07:07:01,165 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-22 07:07:01,165 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1690009620914Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1690009621104 (+190 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1690009621104Loading Region manifests for snaptb0-testConsecutiveExports at 1690009621105 (+1 ms)Writing data manifest for snaptb0-testConsecutiveExports at 1690009621111 (+6 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1690009621127 (+16 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1690009621164 (+37 ms) 2023-07-22 07:07:01,168 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-22 07:07:01,169 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 253 msec 2023-07-22 07:07:01,218 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 07:07:01,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-22 07:07:01,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 07:07:01,220 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/local-export-1690009621220 2023-07-22 07:07:01,221 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/local-export-1690009621220, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/local-export-1690009621220, srcFsUri=hdfs://localhost:45491, srcDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03 2023-07-22 07:07:01,249 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45491, inputRoot=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03 2023-07-22 07:07:01,250 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@3bf74bca, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/local-export-1690009621220, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/local-export-1690009621220/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-22 07:07:01,250 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45491, inputRoot=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03, snapshotDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-22 07:07:01,259 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/local-export-1690009621220/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-22 07:07:01,273 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:01,274 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:01,274 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:01,274 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:01,275 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:01,275 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:01,275 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:01,354 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/hadoop-1573581523253219755.jar 2023-07-22 07:07:01,355 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:01,356 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:01,356 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:01,356 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:01,357 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:01,357 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:01,358 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-22 07:07:01,358 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-22 07:07:01,359 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-22 07:07:01,359 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-22 07:07:01,360 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-22 07:07:01,361 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-22 07:07:01,361 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-22 07:07:01,362 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-22 07:07:01,362 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-22 07:07:01,363 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-22 07:07:01,363 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 07:07:01,364 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 07:07:01,364 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 07:07:01,364 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 07:07:01,365 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 07:07:01,365 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 07:07:01,365 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 07:07:02,203 WARN [Listener at jenkins-hbase4.apache.org/45401] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-22 07:07:02,206 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-22 07:07:02,208 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-22 07:07:04,435 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 07:07:04,435 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 07:07:04,438 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690009582157_0002_000001 (auth:SIMPLE) 2023-07-22 07:07:05,183 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 07:07:05,431 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690009582157_0003_000001 (auth:SIMPLE) 2023-07-22 07:07:09,694 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690009582157_0003_000001 (auth:SIMPLE) 2023-07-22 07:07:11,951 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690009582157_0003_000001 (auth:SIMPLE) 2023-07-22 07:07:14,530 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690009582157_0003_000001 (auth:SIMPLE) 2023-07-22 07:07:16,396 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-22 07:07:16,396 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-22 07:07:16,401 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-22 07:07:16,401 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-22 07:07:16,402 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-22 07:07:16,402 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_663023864_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-22 07:07:16,404 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(367): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-22 07:07:16,404 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(367): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-22 07:07:16,404 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@4d12d4a in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/local-export-1690009621220/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/local-export-1690009621220/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-22 07:07:16,404 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/local-export-1690009621220/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-22 07:07:16,404 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/local-export-1690009621220/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-22 07:07:16,406 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/local-export-1690009621220, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/local-export-1690009621220, srcFsUri=hdfs://localhost:45491, srcDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03 2023-07-22 07:07:16,431 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45491, inputRoot=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03 2023-07-22 07:07:16,431 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@21c88cae, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/local-export-1690009621220, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/local-export-1690009621220/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-22 07:07:16,431 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45491, inputRoot=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03, snapshotDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-22 07:07:16,441 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/local-export-1690009621220/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-22 07:07:16,453 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:16,453 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:16,454 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:16,454 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:16,454 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:16,455 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:16,455 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:16,531 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/hadoop-4202358358893702734.jar 2023-07-22 07:07:16,532 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:16,532 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:16,533 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:16,533 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:16,533 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:16,534 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:16,534 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-22 07:07:16,535 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-22 07:07:16,536 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-22 07:07:16,537 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-22 07:07:16,537 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-22 07:07:16,537 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-22 07:07:16,538 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-22 07:07:16,538 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-22 07:07:16,538 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-22 07:07:16,539 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-22 07:07:16,539 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 07:07:16,540 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 07:07:16,540 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 07:07:16,540 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 07:07:16,540 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 07:07:16,541 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 07:07:16,541 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 07:07:16,907 WARN [Listener at jenkins-hbase4.apache.org/45401] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-22 07:07:16,909 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-22 07:07:16,911 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-22 07:07:20,705 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 07:07:20,705 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 07:07:20,708 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690009582157_0003_000001 (auth:SIMPLE) 2023-07-22 07:07:21,451 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690009582157_0004_000001 (auth:SIMPLE) 2023-07-22 07:07:25,988 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690009582157_0004_000001 (auth:SIMPLE) 2023-07-22 07:07:28,280 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690009582157_0004_000001 (auth:SIMPLE) 2023-07-22 07:07:33,283 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-22 07:07:33,283 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-22 07:07:33,288 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-22 07:07:33,288 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-22 07:07:33,288 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-22 07:07:33,288 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_663023864_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-22 07:07:33,293 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(367): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-22 07:07:33,293 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(367): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-22 07:07:33,293 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@4d12d4a in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/local-export-1690009621220/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/local-export-1690009621220/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-22 07:07:33,294 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/local-export-1690009621220/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-22 07:07:33,294 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/local-export-1690009621220/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-22 07:07:33,312 INFO [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-22 07:07:33,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-22 07:07:33,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-22 07:07:33,318 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690009653318"}]},"ts":"1690009653318"} 2023-07-22 07:07:33,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-22 07:07:33,320 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-22 07:07:33,321 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-22 07:07:33,323 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=89c85a382f3b774d9d841c6defbe2f66, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a524a7c5b080e67489b8e32f2106ab69, UNASSIGN}] 2023-07-22 07:07:33,326 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=89c85a382f3b774d9d841c6defbe2f66, UNASSIGN 2023-07-22 07:07:33,326 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a524a7c5b080e67489b8e32f2106ab69, UNASSIGN 2023-07-22 07:07:33,331 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=89c85a382f3b774d9d841c6defbe2f66, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:33,331 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=a524a7c5b080e67489b8e32f2106ab69, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:33,331 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1690009619877.89c85a382f3b774d9d841c6defbe2f66.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690009653331"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690009653331"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690009653331"}]},"ts":"1690009653331"} 2023-07-22 07:07:33,331 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1690009619877.a524a7c5b080e67489b8e32f2106ab69.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690009653331"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690009653331"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690009653331"}]},"ts":"1690009653331"} 2023-07-22 07:07:33,333 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 89c85a382f3b774d9d841c6defbe2f66, server=jenkins-hbase4.apache.org,44269,1690009574260}] 2023-07-22 07:07:33,334 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure a524a7c5b080e67489b8e32f2106ab69, server=jenkins-hbase4.apache.org,34707,1690009574173}] 2023-07-22 07:07:33,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-22 07:07:33,487 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 89c85a382f3b774d9d841c6defbe2f66 2023-07-22 07:07:33,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 89c85a382f3b774d9d841c6defbe2f66, disabling compactions & flushes 2023-07-22 07:07:33,487 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1690009619877.89c85a382f3b774d9d841c6defbe2f66. 2023-07-22 07:07:33,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1690009619877.89c85a382f3b774d9d841c6defbe2f66. 2023-07-22 07:07:33,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1690009619877.89c85a382f3b774d9d841c6defbe2f66. after waiting 0 ms 2023-07-22 07:07:33,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1690009619877.89c85a382f3b774d9d841c6defbe2f66. 2023-07-22 07:07:33,489 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a524a7c5b080e67489b8e32f2106ab69 2023-07-22 07:07:33,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a524a7c5b080e67489b8e32f2106ab69, disabling compactions & flushes 2023-07-22 07:07:33,489 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1690009619877.a524a7c5b080e67489b8e32f2106ab69. 2023-07-22 07:07:33,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1690009619877.a524a7c5b080e67489b8e32f2106ab69. 2023-07-22 07:07:33,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1690009619877.a524a7c5b080e67489b8e32f2106ab69. after waiting 0 ms 2023-07-22 07:07:33,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1690009619877.a524a7c5b080e67489b8e32f2106ab69. 2023-07-22 07:07:33,568 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testConsecutiveExports/89c85a382f3b774d9d841c6defbe2f66/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 07:07:33,569 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 07:07:33,571 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1690009619877.89c85a382f3b774d9d841c6defbe2f66. 2023-07-22 07:07:33,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 89c85a382f3b774d9d841c6defbe2f66: 2023-07-22 07:07:33,572 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testConsecutiveExports/a524a7c5b080e67489b8e32f2106ab69/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 07:07:33,572 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 89c85a382f3b774d9d841c6defbe2f66 2023-07-22 07:07:33,573 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=89c85a382f3b774d9d841c6defbe2f66, regionState=CLOSED 2023-07-22 07:07:33,573 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 07:07:33,573 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1690009619877.89c85a382f3b774d9d841c6defbe2f66.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690009653573"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690009653573"}]},"ts":"1690009653573"} 2023-07-22 07:07:33,576 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1690009619877.a524a7c5b080e67489b8e32f2106ab69. 2023-07-22 07:07:33,576 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a524a7c5b080e67489b8e32f2106ab69: 2023-07-22 07:07:33,585 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=a524a7c5b080e67489b8e32f2106ab69, regionState=CLOSED 2023-07-22 07:07:33,585 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1690009619877.a524a7c5b080e67489b8e32f2106ab69.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690009653585"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690009653585"}]},"ts":"1690009653585"} 2023-07-22 07:07:33,585 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a524a7c5b080e67489b8e32f2106ab69 2023-07-22 07:07:33,594 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-22 07:07:33,594 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 89c85a382f3b774d9d841c6defbe2f66, server=jenkins-hbase4.apache.org,44269,1690009574260 in 257 msec 2023-07-22 07:07:33,595 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-22 07:07:33,595 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure a524a7c5b080e67489b8e32f2106ab69, server=jenkins-hbase4.apache.org,34707,1690009574173 in 257 msec 2023-07-22 07:07:33,595 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=89c85a382f3b774d9d841c6defbe2f66, UNASSIGN in 272 msec 2023-07-22 07:07:33,606 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-22 07:07:33,606 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a524a7c5b080e67489b8e32f2106ab69, UNASSIGN in 273 msec 2023-07-22 07:07:33,607 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690009653607"}]},"ts":"1690009653607"} 2023-07-22 07:07:33,609 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-22 07:07:33,611 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-22 07:07:33,614 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 300 msec 2023-07-22 07:07:33,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-22 07:07:33,622 INFO [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-22 07:07:33,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-22 07:07:33,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-22 07:07:33,630 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-22 07:07:33,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-22 07:07:33,632 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44269] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-22 07:07:33,635 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 07:07:33,635 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 07:07:33,635 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 07:07:33,635 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 07:07:33,636 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-22 07:07:33,636 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-22 07:07:33,636 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-22 07:07:33,636 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-22 07:07:33,637 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 07:07:33,637 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 07:07:33,637 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:07:33,637 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:07:33,637 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 07:07:33,637 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:07:33,637 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 07:07:33,637 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:07:33,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-22 07:07:33,641 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-22 07:07:33,648 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testConsecutiveExports/89c85a382f3b774d9d841c6defbe2f66 2023-07-22 07:07:33,648 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testConsecutiveExports/a524a7c5b080e67489b8e32f2106ab69 2023-07-22 07:07:33,658 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testConsecutiveExports/a524a7c5b080e67489b8e32f2106ab69/cf, FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testConsecutiveExports/a524a7c5b080e67489b8e32f2106ab69/recovered.edits] 2023-07-22 07:07:33,664 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testConsecutiveExports/a524a7c5b080e67489b8e32f2106ab69/cf/90b7df533f8e4aaca1b73f13a3cc7077 to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/archive/data/default/testtb-testConsecutiveExports/a524a7c5b080e67489b8e32f2106ab69/cf/90b7df533f8e4aaca1b73f13a3cc7077 2023-07-22 07:07:33,667 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testConsecutiveExports/a524a7c5b080e67489b8e32f2106ab69/recovered.edits/9.seqid to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/archive/data/default/testtb-testConsecutiveExports/a524a7c5b080e67489b8e32f2106ab69/recovered.edits/9.seqid 2023-07-22 07:07:33,669 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testConsecutiveExports/a524a7c5b080e67489b8e32f2106ab69 2023-07-22 07:07:33,671 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testConsecutiveExports/89c85a382f3b774d9d841c6defbe2f66/cf, FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testConsecutiveExports/89c85a382f3b774d9d841c6defbe2f66/recovered.edits] 2023-07-22 07:07:33,675 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testConsecutiveExports/89c85a382f3b774d9d841c6defbe2f66/cf/e215b21220c7485fb155a228a0ce7a01 to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/archive/data/default/testtb-testConsecutiveExports/89c85a382f3b774d9d841c6defbe2f66/cf/e215b21220c7485fb155a228a0ce7a01 2023-07-22 07:07:33,678 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testConsecutiveExports/89c85a382f3b774d9d841c6defbe2f66/recovered.edits/9.seqid to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/archive/data/default/testtb-testConsecutiveExports/89c85a382f3b774d9d841c6defbe2f66/recovered.edits/9.seqid 2023-07-22 07:07:33,679 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testConsecutiveExports/89c85a382f3b774d9d841c6defbe2f66 2023-07-22 07:07:33,679 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-22 07:07:33,679 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-22 07:07:33,680 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-22 07:07:33,684 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230722af5d69eb1e8d4f3b85b9eb6ebd1d1111 to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230722af5d69eb1e8d4f3b85b9eb6ebd1d1111 2023-07-22 07:07:33,686 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230722c3cee3c29cae4b5ab7ce919c2f414fd8 to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230722c3cee3c29cae4b5ab7ce919c2f414fd8 2023-07-22 07:07:33,686 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-22 07:07:33,689 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-22 07:07:33,698 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-22 07:07:33,701 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-22 07:07:33,703 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-22 07:07:33,703 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-22 07:07:33,703 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1690009619877.89c85a382f3b774d9d841c6defbe2f66.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690009653703"}]},"ts":"9223372036854775807"} 2023-07-22 07:07:33,703 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1690009619877.a524a7c5b080e67489b8e32f2106ab69.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690009653703"}]},"ts":"9223372036854775807"} 2023-07-22 07:07:33,722 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-22 07:07:33,723 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 89c85a382f3b774d9d841c6defbe2f66, NAME => 'testtb-testConsecutiveExports,,1690009619877.89c85a382f3b774d9d841c6defbe2f66.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a524a7c5b080e67489b8e32f2106ab69, NAME => 'testtb-testConsecutiveExports,1,1690009619877.a524a7c5b080e67489b8e32f2106ab69.', STARTKEY => '1', ENDKEY => ''}] 2023-07-22 07:07:33,723 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-22 07:07:33,723 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690009653723"}]},"ts":"9223372036854775807"} 2023-07-22 07:07:33,731 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-22 07:07:33,739 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-22 07:07:33,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-22 07:07:33,741 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 115 msec 2023-07-22 07:07:33,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-22 07:07:33,941 INFO [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-22 07:07:33,952 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-22 07:07:33,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-22 07:07:33,957 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-22 07:07:33,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-22 07:07:33,995 INFO [Listener at jenkins-hbase4.apache.org/45401] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=744 (was 762), OpenFileDescriptor=895 (was 918), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=368 (was 326) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 179) - ProcessCount LEAK? -, AvailableMemoryMB=6429 (was 6470) 2023-07-22 07:07:33,995 WARN [Listener at jenkins-hbase4.apache.org/45401] hbase.ResourceChecker(130): Thread=744 is superior to 500 2023-07-22 07:07:34,020 INFO [Listener at jenkins-hbase4.apache.org/45401] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=744, OpenFileDescriptor=895, MaxFileDescriptor=60000, SystemLoadAverage=368, ProcessCount=181, AvailableMemoryMB=6428 2023-07-22 07:07:34,020 WARN [Listener at jenkins-hbase4.apache.org/45401] hbase.ResourceChecker(130): Thread=744 is superior to 500 2023-07-22 07:07:34,023 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-22 07:07:34,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,029 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 07:07:34,029 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-22 07:07:34,030 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 07:07:34,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-22 07:07:34,033 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9a0f873965896b6b680aad1a79f865a6 2023-07-22 07:07:34,034 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9a0f873965896b6b680aad1a79f865a6 empty. 2023-07-22 07:07:34,034 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a9fca8ee9bae6ca766b26c91bfc1c7d 2023-07-22 07:07:34,035 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9a0f873965896b6b680aad1a79f865a6 2023-07-22 07:07:34,035 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a9fca8ee9bae6ca766b26c91bfc1c7d empty. 2023-07-22 07:07:34,036 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a9fca8ee9bae6ca766b26c91bfc1c7d 2023-07-22 07:07:34,036 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-22 07:07:34,055 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-22 07:07:34,059 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9a0f873965896b6b680aad1a79f865a6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690009654022.9a0f873965896b6b680aad1a79f865a6.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp 2023-07-22 07:07:34,061 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 3a9fca8ee9bae6ca766b26c91bfc1c7d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690009654022.3a9fca8ee9bae6ca766b26c91bfc1c7d.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp 2023-07-22 07:07:34,082 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1690009654022.9a0f873965896b6b680aad1a79f865a6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 07:07:34,082 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 9a0f873965896b6b680aad1a79f865a6, disabling compactions & flushes 2023-07-22 07:07:34,082 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1690009654022.9a0f873965896b6b680aad1a79f865a6. 2023-07-22 07:07:34,082 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690009654022.9a0f873965896b6b680aad1a79f865a6. 2023-07-22 07:07:34,082 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690009654022.9a0f873965896b6b680aad1a79f865a6. after waiting 0 ms 2023-07-22 07:07:34,082 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1690009654022.9a0f873965896b6b680aad1a79f865a6. 2023-07-22 07:07:34,082 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1690009654022.9a0f873965896b6b680aad1a79f865a6. 2023-07-22 07:07:34,082 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 9a0f873965896b6b680aad1a79f865a6: 2023-07-22 07:07:34,104 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1690009654022.3a9fca8ee9bae6ca766b26c91bfc1c7d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 07:07:34,104 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 3a9fca8ee9bae6ca766b26c91bfc1c7d, disabling compactions & flushes 2023-07-22 07:07:34,104 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1690009654022.3a9fca8ee9bae6ca766b26c91bfc1c7d. 2023-07-22 07:07:34,104 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690009654022.3a9fca8ee9bae6ca766b26c91bfc1c7d. 2023-07-22 07:07:34,104 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690009654022.3a9fca8ee9bae6ca766b26c91bfc1c7d. after waiting 0 ms 2023-07-22 07:07:34,104 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1690009654022.3a9fca8ee9bae6ca766b26c91bfc1c7d. 2023-07-22 07:07:34,104 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1690009654022.3a9fca8ee9bae6ca766b26c91bfc1c7d. 2023-07-22 07:07:34,104 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 3a9fca8ee9bae6ca766b26c91bfc1c7d: 2023-07-22 07:07:34,111 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 07:07:34,112 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690009654022.9a0f873965896b6b680aad1a79f865a6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690009654112"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690009654112"}]},"ts":"1690009654112"} 2023-07-22 07:07:34,112 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690009654022.3a9fca8ee9bae6ca766b26c91bfc1c7d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690009654112"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690009654112"}]},"ts":"1690009654112"} 2023-07-22 07:07:34,126 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-22 07:07:34,127 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 07:07:34,127 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690009654127"}]},"ts":"1690009654127"} 2023-07-22 07:07:34,128 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-22 07:07:34,132 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 07:07:34,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-22 07:07:34,133 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 07:07:34,133 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 07:07:34,133 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 07:07:34,133 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 07:07:34,133 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9a0f873965896b6b680aad1a79f865a6, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3a9fca8ee9bae6ca766b26c91bfc1c7d, ASSIGN}] 2023-07-22 07:07:34,136 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3a9fca8ee9bae6ca766b26c91bfc1c7d, ASSIGN 2023-07-22 07:07:34,136 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9a0f873965896b6b680aad1a79f865a6, ASSIGN 2023-07-22 07:07:34,137 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3a9fca8ee9bae6ca766b26c91bfc1c7d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34707,1690009574173; forceNewPlan=false, retain=false 2023-07-22 07:07:34,138 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9a0f873965896b6b680aad1a79f865a6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44269,1690009574260; forceNewPlan=false, retain=false 2023-07-22 07:07:34,287 INFO [jenkins-hbase4:44609] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-22 07:07:34,293 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=3a9fca8ee9bae6ca766b26c91bfc1c7d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:34,293 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=9a0f873965896b6b680aad1a79f865a6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:34,294 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690009654022.3a9fca8ee9bae6ca766b26c91bfc1c7d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690009654293"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690009654293"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690009654293"}]},"ts":"1690009654293"} 2023-07-22 07:07:34,294 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690009654022.9a0f873965896b6b680aad1a79f865a6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690009654293"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690009654293"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690009654293"}]},"ts":"1690009654293"} 2023-07-22 07:07:34,296 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 9a0f873965896b6b680aad1a79f865a6, server=jenkins-hbase4.apache.org,44269,1690009574260}] 2023-07-22 07:07:34,298 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 3a9fca8ee9bae6ca766b26c91bfc1c7d, server=jenkins-hbase4.apache.org,34707,1690009574173}] 2023-07-22 07:07:34,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-22 07:07:34,453 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1690009654022.9a0f873965896b6b680aad1a79f865a6. 2023-07-22 07:07:34,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9a0f873965896b6b680aad1a79f865a6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690009654022.9a0f873965896b6b680aad1a79f865a6.', STARTKEY => '', ENDKEY => '1'} 2023-07-22 07:07:34,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1690009654022.9a0f873965896b6b680aad1a79f865a6. service=AccessControlService 2023-07-22 07:07:34,454 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 07:07:34,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 9a0f873965896b6b680aad1a79f865a6 2023-07-22 07:07:34,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1690009654022.9a0f873965896b6b680aad1a79f865a6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 07:07:34,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9a0f873965896b6b680aad1a79f865a6 2023-07-22 07:07:34,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9a0f873965896b6b680aad1a79f865a6 2023-07-22 07:07:34,461 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1690009654022.3a9fca8ee9bae6ca766b26c91bfc1c7d. 2023-07-22 07:07:34,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3a9fca8ee9bae6ca766b26c91bfc1c7d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690009654022.3a9fca8ee9bae6ca766b26c91bfc1c7d.', STARTKEY => '1', ENDKEY => ''} 2023-07-22 07:07:34,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1690009654022.3a9fca8ee9bae6ca766b26c91bfc1c7d. service=AccessControlService 2023-07-22 07:07:34,462 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 07:07:34,462 INFO [StoreOpener-9a0f873965896b6b680aad1a79f865a6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9a0f873965896b6b680aad1a79f865a6 2023-07-22 07:07:34,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 3a9fca8ee9bae6ca766b26c91bfc1c7d 2023-07-22 07:07:34,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1690009654022.3a9fca8ee9bae6ca766b26c91bfc1c7d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 07:07:34,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3a9fca8ee9bae6ca766b26c91bfc1c7d 2023-07-22 07:07:34,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3a9fca8ee9bae6ca766b26c91bfc1c7d 2023-07-22 07:07:34,465 DEBUG [StoreOpener-9a0f873965896b6b680aad1a79f865a6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion/9a0f873965896b6b680aad1a79f865a6/cf 2023-07-22 07:07:34,465 DEBUG [StoreOpener-9a0f873965896b6b680aad1a79f865a6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion/9a0f873965896b6b680aad1a79f865a6/cf 2023-07-22 07:07:34,465 INFO [StoreOpener-3a9fca8ee9bae6ca766b26c91bfc1c7d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3a9fca8ee9bae6ca766b26c91bfc1c7d 2023-07-22 07:07:34,466 INFO [StoreOpener-9a0f873965896b6b680aad1a79f865a6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9a0f873965896b6b680aad1a79f865a6 columnFamilyName cf 2023-07-22 07:07:34,468 INFO [StoreOpener-9a0f873965896b6b680aad1a79f865a6-1] regionserver.HStore(310): Store=9a0f873965896b6b680aad1a79f865a6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 07:07:34,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion/9a0f873965896b6b680aad1a79f865a6 2023-07-22 07:07:34,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion/9a0f873965896b6b680aad1a79f865a6 2023-07-22 07:07:34,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9a0f873965896b6b680aad1a79f865a6 2023-07-22 07:07:34,481 DEBUG [StoreOpener-3a9fca8ee9bae6ca766b26c91bfc1c7d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a9fca8ee9bae6ca766b26c91bfc1c7d/cf 2023-07-22 07:07:34,481 DEBUG [StoreOpener-3a9fca8ee9bae6ca766b26c91bfc1c7d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a9fca8ee9bae6ca766b26c91bfc1c7d/cf 2023-07-22 07:07:34,481 INFO [StoreOpener-3a9fca8ee9bae6ca766b26c91bfc1c7d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3a9fca8ee9bae6ca766b26c91bfc1c7d columnFamilyName cf 2023-07-22 07:07:34,482 INFO [StoreOpener-3a9fca8ee9bae6ca766b26c91bfc1c7d-1] regionserver.HStore(310): Store=3a9fca8ee9bae6ca766b26c91bfc1c7d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 07:07:34,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a9fca8ee9bae6ca766b26c91bfc1c7d 2023-07-22 07:07:34,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion/9a0f873965896b6b680aad1a79f865a6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 07:07:34,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a9fca8ee9bae6ca766b26c91bfc1c7d 2023-07-22 07:07:34,493 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9a0f873965896b6b680aad1a79f865a6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68375874, jitterRate=0.01887992024421692}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 07:07:34,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9a0f873965896b6b680aad1a79f865a6: 2023-07-22 07:07:34,494 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1690009654022.9a0f873965896b6b680aad1a79f865a6., pid=60, masterSystemTime=1690009654449 2023-07-22 07:07:34,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1690009654022.9a0f873965896b6b680aad1a79f865a6. 2023-07-22 07:07:34,496 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1690009654022.9a0f873965896b6b680aad1a79f865a6. 2023-07-22 07:07:34,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3a9fca8ee9bae6ca766b26c91bfc1c7d 2023-07-22 07:07:34,499 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=9a0f873965896b6b680aad1a79f865a6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:34,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a9fca8ee9bae6ca766b26c91bfc1c7d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 07:07:34,499 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690009654022.9a0f873965896b6b680aad1a79f865a6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690009654498"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690009654498"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690009654498"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690009654498"}]},"ts":"1690009654498"} 2023-07-22 07:07:34,499 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3a9fca8ee9bae6ca766b26c91bfc1c7d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59684914, jitterRate=-0.11062547564506531}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 07:07:34,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3a9fca8ee9bae6ca766b26c91bfc1c7d: 2023-07-22 07:07:34,500 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1690009654022.3a9fca8ee9bae6ca766b26c91bfc1c7d., pid=61, masterSystemTime=1690009654454 2023-07-22 07:07:34,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1690009654022.3a9fca8ee9bae6ca766b26c91bfc1c7d. 2023-07-22 07:07:34,502 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1690009654022.3a9fca8ee9bae6ca766b26c91bfc1c7d. 2023-07-22 07:07:34,503 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=3a9fca8ee9bae6ca766b26c91bfc1c7d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:34,503 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690009654022.3a9fca8ee9bae6ca766b26c91bfc1c7d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690009654502"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690009654502"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690009654502"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690009654502"}]},"ts":"1690009654502"} 2023-07-22 07:07:34,504 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-22 07:07:34,504 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 9a0f873965896b6b680aad1a79f865a6, server=jenkins-hbase4.apache.org,44269,1690009574260 in 205 msec 2023-07-22 07:07:34,506 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9a0f873965896b6b680aad1a79f865a6, ASSIGN in 371 msec 2023-07-22 07:07:34,507 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-22 07:07:34,508 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 3a9fca8ee9bae6ca766b26c91bfc1c7d, server=jenkins-hbase4.apache.org,34707,1690009574173 in 207 msec 2023-07-22 07:07:34,510 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-22 07:07:34,510 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3a9fca8ee9bae6ca766b26c91bfc1c7d, ASSIGN in 374 msec 2023-07-22 07:07:34,515 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 07:07:34,516 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690009654515"}]},"ts":"1690009654515"} 2023-07-22 07:07:34,517 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-22 07:07:34,522 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 07:07:34,522 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-22 07:07:34,525 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44269] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-22 07:07:34,527 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:07:34,528 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:07:34,528 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:07:34,528 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:07:34,530 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 07:07:34,531 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 07:07:34,531 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 07:07:34,531 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 07:07:34,533 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 507 msec 2023-07-22 07:07:34,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-22 07:07:34,636 INFO [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-22 07:07:34,639 DEBUG [Listener at jenkins-hbase4.apache.org/45401] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,639 DEBUG [Listener at jenkins-hbase4.apache.org/45401] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1690009654022.9a0f873965896b6b680aad1a79f865a6. 2023-07-22 07:07:34,641 INFO [Listener at jenkins-hbase4.apache.org/45401] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 07:07:34,659 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-22 07:07:34,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690009654659 (current time:1690009654659). 2023-07-22 07:07:34,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 07:07:34,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(139): Connect 0x446f20bb to 127.0.0.1:63277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 07:07:34,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@78c42893, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 07:07:34,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 07:07:34,670 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44234, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 07:07:34,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x446f20bb to 127.0.0.1:63277 2023-07-22 07:07:34,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 07:07:34,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(139): Connect 0x748b85bd to 127.0.0.1:63277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 07:07:34,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@495c096f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 07:07:34,683 DEBUG [hconnection-0x10053067-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 07:07:34,685 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44250, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 07:07:34,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 07:07:34,692 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49758, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 07:07:34,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x748b85bd to 127.0.0.1:63277 2023-07-22 07:07:34,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 07:07:34,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-22 07:07:34,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 07:07:34,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-22 07:07:34,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-22 07:07:34,698 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-22 07:07:34,699 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1690010254699 2023-07-22 07:07:34,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-22 07:07:34,699 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,700 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 07:07:34,701 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 07:07:34,702 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-22 07:07:34,702 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-22 07:07:34,703 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-22 07:07:34,704 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-22 07:07:34,705 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1690010254705 2023-07-22 07:07:34,745 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,745 INFO [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-22 07:07:34,746 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:07:34,747 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-22 07:07:34,747 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-22 07:07:34,748 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,748 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,751 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:07:34,751 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:07:34,751 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:34,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:07:34,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:07:34,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:07:34,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:07:34,752 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:34,752 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:34,752 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:07:34,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:07:34,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:07:34,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,752 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:34,752 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 07:07:34,752 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-22 07:07:34,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,753 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,753 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,753 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-22 07:07:34,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-22 07:07:34,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,753 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,753 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-22 07:07:34,753 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-22 07:07:34,753 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:07:34,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-22 07:07:34,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,754 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-22 07:07:34,758 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,759 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-22 07:07:34,759 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:07:34,759 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,759 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-22 07:07:34,759 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:07:34,768 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-22 07:07:34,768 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-22 07:07:34,768 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-22 07:07:34,768 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43271,1690009574333' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-22 07:07:34,768 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-22 07:07:34,768 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-22 07:07:34,768 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-22 07:07:34,768 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34707,1690009574173' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-22 07:07:34,768 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44269,1690009574260' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-22 07:07:34,770 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,771 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:34,771 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:34,771 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:34,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:07:34,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:07:34,771 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,771 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 07:07:34,771 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,772 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,772 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 07:07:34,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:07:34,772 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,772 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 07:07:34,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:07:34,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:34,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:34,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:34,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:07:34,774 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34707,1690009574173' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-22 07:07:34,774 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e740ba8[Count = 1] remaining members to acquire global barrier 2023-07-22 07:07:34,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:34,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:07:34,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:07:34,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:07:34,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:07:34,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:34,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:34,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:34,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:07:34,778 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44269,1690009574260' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-22 07:07:34,779 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e740ba8[Count = 0] remaining members to acquire global barrier 2023-07-22 07:07:34,779 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-22 07:07:34,779 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,780 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,780 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,780 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,780 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:34,780 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-22 07:07:34,780 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-22 07:07:34,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,780 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43271,1690009574333' in zk 2023-07-22 07:07:34,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,781 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-22 07:07:34,781 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:34,781 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 07:07:34,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,781 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 07:07:34,781 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 07:07:34,781 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690009654022.3a9fca8ee9bae6ca766b26c91bfc1c7d. 2023-07-22 07:07:34,781 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-22 07:07:34,781 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690009654022.3a9fca8ee9bae6ca766b26c91bfc1c7d. started... 2023-07-22 07:07:34,781 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 07:07:34,782 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690009654022.9a0f873965896b6b680aad1a79f865a6. 2023-07-22 07:07:34,783 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3a9fca8ee9bae6ca766b26c91bfc1c7d: 2023-07-22 07:07:34,783 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690009654022.9a0f873965896b6b680aad1a79f865a6. started... 2023-07-22 07:07:34,782 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 07:07:34,783 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1690009654022.3a9fca8ee9bae6ca766b26c91bfc1c7d.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,783 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9a0f873965896b6b680aad1a79f865a6: 2023-07-22 07:07:34,783 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 07:07:34,783 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 07:07:34,783 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1690009654022.9a0f873965896b6b680aad1a79f865a6.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,783 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 07:07:34,783 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 07:07:34,790 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-22 07:07:34,790 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:07:34,790 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-22 07:07:34,799 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690009654022.3a9fca8ee9bae6ca766b26c91bfc1c7d. completed. 2023-07-22 07:07:34,799 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690009654022.3a9fca8ee9bae6ca766b26c91bfc1c7d. 2023-07-22 07:07:34,799 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 07:07:34,799 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 07:07:34,799 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:34,799 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-22 07:07:34,799 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34707,1690009574173' in zk 2023-07-22 07:07:34,800 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-22 07:07:34,801 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:07:34,800 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:34,802 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 07:07:34,801 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-22 07:07:34,802 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690009654022.9a0f873965896b6b680aad1a79f865a6. completed. 2023-07-22 07:07:34,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:34,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:07:34,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:07:34,802 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690009654022.9a0f873965896b6b680aad1a79f865a6. 2023-07-22 07:07:34,802 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 07:07:34,803 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 07:07:34,803 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:34,803 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-22 07:07:34,803 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44269,1690009574260' in zk 2023-07-22 07:07:34,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:07:34,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-22 07:07:34,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-22 07:07:34,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:07:34,804 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 07:07:34,820 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:34,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,820 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-22 07:07:34,821 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:07:34,821 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-22 07:07:34,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:34,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:34,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:34,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:07:34,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:34,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:34,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:34,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34707,1690009574173': 2023-07-22 07:07:34,826 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34707,1690009574173' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-22 07:07:34,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:34,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:07:34,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:07:34,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:07:34,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:07:34,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:34,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:34,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:34,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:07:34,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:34,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:34,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:34,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,44269,1690009574260': 2023-07-22 07:07:34,831 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44269,1690009574260' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-22 07:07:34,832 INFO [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-22 07:07:34,832 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 07:07:34,832 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 07:07:34,832 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,832 INFO [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 07:07:34,834 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,834 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,834 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,834 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:07:34,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:07:34,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:07:34,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,834 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:07:34,834 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,834 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:07:34,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:07:34,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:07:34,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:07:34,835 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:34,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:07:34,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:07:34,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:07:34,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:07:34,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,836 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:34,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:07:34,836 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:34,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:34,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:34,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:34,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:07:34,838 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:34,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,839 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:34,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:34,842 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:34,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:34,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:34,850 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:07:34,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:07:34,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:07:34,850 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:34,850 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:07:34,850 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:07:34,850 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:07:34,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:07:34,850 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:07:34,850 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,850 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:07:34,853 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,850 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:07:34,850 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:07:34,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:07:34,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:07:34,853 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:34,853 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-22 07:07:34,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:07:34,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:07:34,851 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:07:34,853 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:34,853 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,853 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:34,853 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,853 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:34,853 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:34,854 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,854 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:07:34,854 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-22 07:07:34,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:07:34,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:07:34,868 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,869 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:34,918 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,004 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 07:07:35,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-22 07:07:35,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-22 07:07:35,005 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-22 07:07:35,281 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-22 07:07:35,306 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 07:07:35,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-22 07:07:35,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-22 07:07:35,307 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-22 07:07:35,364 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-22 07:07:35,364 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,364 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,364 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1690009654699Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1690009654868 (+169 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690009654868Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690009654868Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690009654872 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690009654903 (+31 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1690009655364 (+461 ms) 2023-07-22 07:07:35,367 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-22 07:07:35,369 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 667 msec 2023-07-22 07:07:35,808 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 07:07:35,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-22 07:07:35,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 07:07:35,812 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44269] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1690009654022.9a0f873965896b6b680aad1a79f865a6. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 07:07:35,814 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34707] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1690009654022.3a9fca8ee9bae6ca766b26c91bfc1c7d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 07:07:35,817 DEBUG [Listener at jenkins-hbase4.apache.org/45401] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,817 DEBUG [Listener at jenkins-hbase4.apache.org/45401] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1690009654022.9a0f873965896b6b680aad1a79f865a6. 2023-07-22 07:07:35,817 INFO [Listener at jenkins-hbase4.apache.org/45401] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 07:07:35,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-22 07:07:35,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690009655828 (current time:1690009655828). 2023-07-22 07:07:35,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 07:07:35,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(139): Connect 0x427d349e to 127.0.0.1:63277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 07:07:35,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@280f093a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 07:07:35,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 07:07:35,839 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44252, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 07:07:35,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x427d349e to 127.0.0.1:63277 2023-07-22 07:07:35,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 07:07:35,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(139): Connect 0x7209279f to 127.0.0.1:63277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 07:07:35,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59fb3484, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 07:07:35,847 DEBUG [hconnection-0x9eda058-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 07:07:35,849 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44262, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 07:07:35,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 07:07:35,855 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49760, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 07:07:35,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7209279f to 127.0.0.1:63277 2023-07-22 07:07:35,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 07:07:35,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-22 07:07:35,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 07:07:35,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-22 07:07:35,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-22 07:07:35,860 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-22 07:07:35,861 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1690010255861 2023-07-22 07:07:35,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-22 07:07:35,861 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,862 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 07:07:35,862 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 07:07:35,862 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-22 07:07:35,863 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-22 07:07:35,864 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-07-22 07:07:35,865 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-22 07:07:35,865 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1690010255865 2023-07-22 07:07:35,875 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,875 INFO [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-22 07:07:35,875 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:07:35,876 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-22 07:07:35,876 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-22 07:07:35,876 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,877 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,878 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:07:35,878 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:07:35,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:07:35,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:07:35,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:07:35,878 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:07:35,878 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:35,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:07:35,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:07:35,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:07:35,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,879 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:35,879 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:35,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,879 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,879 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:35,879 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 07:07:35,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,879 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-22 07:07:35,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,879 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,880 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-22 07:07:35,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-22 07:07:35,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-22 07:07:35,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,880 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-22 07:07:35,880 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-22 07:07:35,882 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,882 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,883 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,883 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-22 07:07:35,883 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-22 07:07:35,883 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:07:35,883 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-22 07:07:35,884 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-22 07:07:35,884 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-22 07:07:35,883 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:07:35,884 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34707,1690009574173' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-22 07:07:35,885 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-22 07:07:35,885 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-22 07:07:35,884 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:07:35,885 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43271,1690009574333' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-22 07:07:35,886 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-22 07:07:35,886 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-22 07:07:35,886 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44269,1690009574260' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-22 07:07:35,887 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:35,887 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:35,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:07:35,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:07:35,888 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,888 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,888 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 07:07:35,890 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,890 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:35,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:07:35,890 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,890 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 07:07:35,890 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,890 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 07:07:35,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:07:35,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:35,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:35,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:35,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:07:35,892 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34707,1690009574173' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-22 07:07:35,892 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ef32a02[Count = 1] remaining members to acquire global barrier 2023-07-22 07:07:35,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:35,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:07:35,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:07:35,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:07:35,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:07:35,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:35,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:35,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:35,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:07:35,894 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44269,1690009574260' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-22 07:07:35,894 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ef32a02[Count = 0] remaining members to acquire global barrier 2023-07-22 07:07:35,894 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-22 07:07:35,894 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,895 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,896 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,895 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,896 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-22 07:07:35,896 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-22 07:07:35,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,896 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:35,896 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 07:07:35,896 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 07:07:35,896 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690009654022.3a9fca8ee9bae6ca766b26c91bfc1c7d. 2023-07-22 07:07:35,896 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-22 07:07:35,896 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690009654022.3a9fca8ee9bae6ca766b26c91bfc1c7d. started... 2023-07-22 07:07:35,896 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43271,1690009574333' in zk 2023-07-22 07:07:35,896 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-22 07:07:35,896 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:35,896 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 07:07:35,896 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 07:07:35,896 INFO [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3a9fca8ee9bae6ca766b26c91bfc1c7d 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-22 07:07:35,896 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690009654022.9a0f873965896b6b680aad1a79f865a6. 2023-07-22 07:07:35,896 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 07:07:35,897 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690009654022.9a0f873965896b6b680aad1a79f865a6. started... 2023-07-22 07:07:35,897 INFO [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9a0f873965896b6b680aad1a79f865a6 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-22 07:07:35,898 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-22 07:07:35,898 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:07:35,898 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-22 07:07:35,915 INFO [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230722888058b6d33d46c6aa69b6b11d21ecde to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230722888058b6d33d46c6aa69b6b11d21ecde 2023-07-22 07:07:35,917 INFO [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230722510c8f205cd54eb6afbba9d140bcfd13 to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230722510c8f205cd54eb6afbba9d140bcfd13 2023-07-22 07:07:35,927 INFO [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion/9a0f873965896b6b680aad1a79f865a6/.tmp/cf/060d5ca5c1d04bc08bb18d9554d2a223 2023-07-22 07:07:35,930 INFO [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a9fca8ee9bae6ca766b26c91bfc1c7d/.tmp/cf/70436799deaa40d2aa1942d0ed53b8b4 2023-07-22 07:07:35,933 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion/9a0f873965896b6b680aad1a79f865a6/.tmp/cf/060d5ca5c1d04bc08bb18d9554d2a223 as hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion/9a0f873965896b6b680aad1a79f865a6/cf/060d5ca5c1d04bc08bb18d9554d2a223 2023-07-22 07:07:35,936 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a9fca8ee9bae6ca766b26c91bfc1c7d/.tmp/cf/70436799deaa40d2aa1942d0ed53b8b4 as hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a9fca8ee9bae6ca766b26c91bfc1c7d/cf/70436799deaa40d2aa1942d0ed53b8b4 2023-07-22 07:07:35,938 INFO [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion/9a0f873965896b6b680aad1a79f865a6/cf/060d5ca5c1d04bc08bb18d9554d2a223, entries=3, sequenceid=6, filesize=5.4 K 2023-07-22 07:07:35,939 INFO [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 9a0f873965896b6b680aad1a79f865a6 in 42ms, sequenceid=6, compaction requested=false 2023-07-22 07:07:35,941 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9a0f873965896b6b680aad1a79f865a6: 2023-07-22 07:07:35,941 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1690009654022.9a0f873965896b6b680aad1a79f865a6.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,941 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 07:07:35,941 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion/9a0f873965896b6b680aad1a79f865a6/cf/060d5ca5c1d04bc08bb18d9554d2a223] hfiles 2023-07-22 07:07:35,941 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion/9a0f873965896b6b680aad1a79f865a6/cf/060d5ca5c1d04bc08bb18d9554d2a223 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,942 INFO [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a9fca8ee9bae6ca766b26c91bfc1c7d/cf/70436799deaa40d2aa1942d0ed53b8b4, entries=47, sequenceid=6, filesize=13.5 K 2023-07-22 07:07:35,945 INFO [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 3a9fca8ee9bae6ca766b26c91bfc1c7d in 49ms, sequenceid=6, compaction requested=false 2023-07-22 07:07:35,945 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3a9fca8ee9bae6ca766b26c91bfc1c7d: 2023-07-22 07:07:35,945 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1690009654022.3a9fca8ee9bae6ca766b26c91bfc1c7d.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,945 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 07:07:35,945 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a9fca8ee9bae6ca766b26c91bfc1c7d/cf/70436799deaa40d2aa1942d0ed53b8b4] hfiles 2023-07-22 07:07:35,945 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a9fca8ee9bae6ca766b26c91bfc1c7d/cf/70436799deaa40d2aa1942d0ed53b8b4 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,962 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 07:07:35,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-22 07:07:35,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-22 07:07:35,964 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 07:07:35,970 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690009654022.9a0f873965896b6b680aad1a79f865a6. completed. 2023-07-22 07:07:35,970 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690009654022.9a0f873965896b6b680aad1a79f865a6. 2023-07-22 07:07:35,970 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 07:07:35,970 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 07:07:35,970 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:35,970 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690009654022.3a9fca8ee9bae6ca766b26c91bfc1c7d. completed. 2023-07-22 07:07:35,970 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690009654022.3a9fca8ee9bae6ca766b26c91bfc1c7d. 2023-07-22 07:07:35,970 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-22 07:07:35,970 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44269,1690009574260' in zk 2023-07-22 07:07:35,970 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 07:07:35,970 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 07:07:35,970 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:35,970 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-22 07:07:35,970 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34707,1690009574173' in zk 2023-07-22 07:07:35,971 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:35,971 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-22 07:07:35,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:35,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:07:35,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:07:35,972 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:07:35,972 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-22 07:07:35,973 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:35,973 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-22 07:07:35,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:07:35,974 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:07:35,974 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-22 07:07:35,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:07:35,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:35,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:35,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:35,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:07:35,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:35,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:35,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:35,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,44269,1690009574260': 2023-07-22 07:07:35,979 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44269,1690009574260' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-22 07:07:35,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:35,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:07:35,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:07:35,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:07:35,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:07:35,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:35,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:35,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:35,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:07:35,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:35,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:35,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:35,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34707,1690009574173': 2023-07-22 07:07:35,985 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34707,1690009574173' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-22 07:07:35,985 INFO [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-22 07:07:35,985 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 07:07:35,985 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 07:07:35,985 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,985 INFO [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 07:07:35,997 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,997 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,997 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:07:35,997 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,997 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:07:35,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,997 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,998 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:07:35,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:07:35,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:07:35,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:07:35,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:07:35,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:07:35,998 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:35,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:07:35,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:07:35,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:07:35,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:07:35,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:35,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:36,000 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:36,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:36,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:07:36,000 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:36,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:36,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:36,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:36,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:36,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:07:36,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:36,002 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:36,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:36,003 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:36,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:36,003 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:36,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:36,009 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:07:36,009 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:07:36,009 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:07:36,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:07:36,009 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:07:36,009 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:36,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:07:36,009 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:07:36,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:07:36,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:07:36,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:07:36,009 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:36,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:07:36,009 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:07:36,009 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:07:36,009 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:36,009 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:36,009 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:36,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:07:36,011 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:36,010 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:36,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:07:36,011 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:36,011 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-22 07:07:36,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:07:36,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:07:36,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:07:36,012 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:36,012 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:36,012 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:36,012 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:36,012 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:36,012 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:36,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:07:36,013 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230722510c8f205cd54eb6afbba9d140bcfd13, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230722888058b6d33d46c6aa69b6b11d21ecde] mob files 2023-07-22 07:07:36,013 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230722510c8f205cd54eb6afbba9d140bcfd13 2023-07-22 07:07:36,013 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230722888058b6d33d46c6aa69b6b11d21ecde 2023-07-22 07:07:36,025 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:36,026 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:36,061 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:36,089 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-22 07:07:36,089 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:36,089 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:36,089 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1690009655861Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1690009656025 (+164 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1690009656025Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1690009656025Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1690009656029 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1690009656048 (+19 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1690009656089 (+41 ms) 2023-07-22 07:07:36,092 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-22 07:07:36,094 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 230 msec 2023-07-22 07:07:36,164 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 07:07:36,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-22 07:07:36,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 07:07:36,202 DEBUG [Listener at jenkins-hbase4.apache.org/45401] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-22 07:07:36,208 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59286, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-22 07:07:36,209 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34707] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-22 07:07:36,210 DEBUG [Listener at jenkins-hbase4.apache.org/45401] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-22 07:07:36,211 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44264, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-22 07:07:36,212 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43271] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-22 07:07:36,212 DEBUG [Listener at jenkins-hbase4.apache.org/45401] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-22 07:07:36,213 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49770, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-22 07:07:36,214 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44269] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-22 07:07:36,216 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-22 07:07:36,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:36,220 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 07:07:36,220 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-22 07:07:36,221 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 07:07:36,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-22 07:07:36,224 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f19b253bed6437e6f1d4dfa4d7733b88 2023-07-22 07:07:36,224 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81bf0c4651ba33729c58f883569df57a 2023-07-22 07:07:36,225 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f19b253bed6437e6f1d4dfa4d7733b88 empty. 2023-07-22 07:07:36,225 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81bf0c4651ba33729c58f883569df57a empty. 2023-07-22 07:07:36,225 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81bf0c4651ba33729c58f883569df57a 2023-07-22 07:07:36,225 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f19b253bed6437e6f1d4dfa4d7733b88 2023-07-22 07:07:36,226 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-22 07:07:36,246 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-22 07:07:36,247 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => f19b253bed6437e6f1d4dfa4d7733b88, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656215.f19b253bed6437e6f1d4dfa4d7733b88.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp 2023-07-22 07:07:36,248 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 81bf0c4651ba33729c58f883569df57a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1690009656215.81bf0c4651ba33729c58f883569df57a.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp 2023-07-22 07:07:36,271 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1690009656215.81bf0c4651ba33729c58f883569df57a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 07:07:36,271 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 81bf0c4651ba33729c58f883569df57a, disabling compactions & flushes 2023-07-22 07:07:36,271 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690009656215.81bf0c4651ba33729c58f883569df57a. 2023-07-22 07:07:36,271 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690009656215.81bf0c4651ba33729c58f883569df57a. 2023-07-22 07:07:36,271 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690009656215.81bf0c4651ba33729c58f883569df57a. after waiting 0 ms 2023-07-22 07:07:36,271 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690009656215.81bf0c4651ba33729c58f883569df57a. 2023-07-22 07:07:36,271 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1690009656215.81bf0c4651ba33729c58f883569df57a. 2023-07-22 07:07:36,271 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 81bf0c4651ba33729c58f883569df57a: 2023-07-22 07:07:36,275 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656215.f19b253bed6437e6f1d4dfa4d7733b88.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 07:07:36,275 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing f19b253bed6437e6f1d4dfa4d7733b88, disabling compactions & flushes 2023-07-22 07:07:36,275 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656215.f19b253bed6437e6f1d4dfa4d7733b88. 2023-07-22 07:07:36,275 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656215.f19b253bed6437e6f1d4dfa4d7733b88. 2023-07-22 07:07:36,275 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656215.f19b253bed6437e6f1d4dfa4d7733b88. after waiting 0 ms 2023-07-22 07:07:36,275 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656215.f19b253bed6437e6f1d4dfa4d7733b88. 2023-07-22 07:07:36,275 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656215.f19b253bed6437e6f1d4dfa4d7733b88. 2023-07-22 07:07:36,275 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for f19b253bed6437e6f1d4dfa4d7733b88: 2023-07-22 07:07:36,278 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 07:07:36,278 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690009656215.81bf0c4651ba33729c58f883569df57a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690009656278"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690009656278"}]},"ts":"1690009656278"} 2023-07-22 07:07:36,279 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656215.f19b253bed6437e6f1d4dfa4d7733b88.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690009656278"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690009656278"}]},"ts":"1690009656278"} 2023-07-22 07:07:36,281 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-22 07:07:36,282 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 07:07:36,282 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690009656282"}]},"ts":"1690009656282"} 2023-07-22 07:07:36,283 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-22 07:07:36,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-22 07:07:36,355 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 07:07:36,357 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 07:07:36,357 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 07:07:36,357 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 07:07:36,358 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 07:07:36,358 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f19b253bed6437e6f1d4dfa4d7733b88, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=81bf0c4651ba33729c58f883569df57a, ASSIGN}] 2023-07-22 07:07:36,375 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=81bf0c4651ba33729c58f883569df57a, ASSIGN 2023-07-22 07:07:36,375 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f19b253bed6437e6f1d4dfa4d7733b88, ASSIGN 2023-07-22 07:07:36,377 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=81bf0c4651ba33729c58f883569df57a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43271,1690009574333; forceNewPlan=false, retain=false 2023-07-22 07:07:36,377 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f19b253bed6437e6f1d4dfa4d7733b88, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44269,1690009574260; forceNewPlan=false, retain=false 2023-07-22 07:07:36,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-22 07:07:36,534 INFO [jenkins-hbase4:44609] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-22 07:07:36,538 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=f19b253bed6437e6f1d4dfa4d7733b88, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:36,538 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=81bf0c4651ba33729c58f883569df57a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:36,538 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656215.f19b253bed6437e6f1d4dfa4d7733b88.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690009656538"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690009656538"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690009656538"}]},"ts":"1690009656538"} 2023-07-22 07:07:36,538 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690009656215.81bf0c4651ba33729c58f883569df57a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690009656538"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690009656538"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690009656538"}]},"ts":"1690009656538"} 2023-07-22 07:07:36,543 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 81bf0c4651ba33729c58f883569df57a, server=jenkins-hbase4.apache.org,43271,1690009574333}] 2023-07-22 07:07:36,547 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure f19b253bed6437e6f1d4dfa4d7733b88, server=jenkins-hbase4.apache.org,44269,1690009574260}] 2023-07-22 07:07:36,704 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1690009656215.81bf0c4651ba33729c58f883569df57a. 2023-07-22 07:07:36,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 81bf0c4651ba33729c58f883569df57a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1690009656215.81bf0c4651ba33729c58f883569df57a.', STARTKEY => '2', ENDKEY => ''} 2023-07-22 07:07:36,704 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656215.f19b253bed6437e6f1d4dfa4d7733b88. 2023-07-22 07:07:36,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f19b253bed6437e6f1d4dfa4d7733b88, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656215.f19b253bed6437e6f1d4dfa4d7733b88.', STARTKEY => '', ENDKEY => '2'} 2023-07-22 07:07:36,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1690009656215.81bf0c4651ba33729c58f883569df57a. service=AccessControlService 2023-07-22 07:07:36,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656215.f19b253bed6437e6f1d4dfa4d7733b88. service=AccessControlService 2023-07-22 07:07:36,705 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 07:07:36,705 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 07:07:36,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 81bf0c4651ba33729c58f883569df57a 2023-07-22 07:07:36,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 f19b253bed6437e6f1d4dfa4d7733b88 2023-07-22 07:07:36,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1690009656215.81bf0c4651ba33729c58f883569df57a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 07:07:36,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656215.f19b253bed6437e6f1d4dfa4d7733b88.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 07:07:36,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 81bf0c4651ba33729c58f883569df57a 2023-07-22 07:07:36,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f19b253bed6437e6f1d4dfa4d7733b88 2023-07-22 07:07:36,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 81bf0c4651ba33729c58f883569df57a 2023-07-22 07:07:36,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f19b253bed6437e6f1d4dfa4d7733b88 2023-07-22 07:07:36,707 INFO [StoreOpener-f19b253bed6437e6f1d4dfa4d7733b88-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f19b253bed6437e6f1d4dfa4d7733b88 2023-07-22 07:07:36,707 INFO [StoreOpener-81bf0c4651ba33729c58f883569df57a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 81bf0c4651ba33729c58f883569df57a 2023-07-22 07:07:36,709 DEBUG [StoreOpener-f19b253bed6437e6f1d4dfa4d7733b88-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f19b253bed6437e6f1d4dfa4d7733b88/cf 2023-07-22 07:07:36,709 DEBUG [StoreOpener-f19b253bed6437e6f1d4dfa4d7733b88-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f19b253bed6437e6f1d4dfa4d7733b88/cf 2023-07-22 07:07:36,709 DEBUG [StoreOpener-81bf0c4651ba33729c58f883569df57a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81bf0c4651ba33729c58f883569df57a/cf 2023-07-22 07:07:36,709 DEBUG [StoreOpener-81bf0c4651ba33729c58f883569df57a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81bf0c4651ba33729c58f883569df57a/cf 2023-07-22 07:07:36,710 INFO [StoreOpener-f19b253bed6437e6f1d4dfa4d7733b88-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f19b253bed6437e6f1d4dfa4d7733b88 columnFamilyName cf 2023-07-22 07:07:36,710 INFO [StoreOpener-81bf0c4651ba33729c58f883569df57a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 81bf0c4651ba33729c58f883569df57a columnFamilyName cf 2023-07-22 07:07:36,711 INFO [StoreOpener-81bf0c4651ba33729c58f883569df57a-1] regionserver.HStore(310): Store=81bf0c4651ba33729c58f883569df57a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 07:07:36,711 INFO [StoreOpener-f19b253bed6437e6f1d4dfa4d7733b88-1] regionserver.HStore(310): Store=f19b253bed6437e6f1d4dfa4d7733b88/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 07:07:36,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81bf0c4651ba33729c58f883569df57a 2023-07-22 07:07:36,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81bf0c4651ba33729c58f883569df57a 2023-07-22 07:07:36,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f19b253bed6437e6f1d4dfa4d7733b88 2023-07-22 07:07:36,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f19b253bed6437e6f1d4dfa4d7733b88 2023-07-22 07:07:36,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 81bf0c4651ba33729c58f883569df57a 2023-07-22 07:07:36,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f19b253bed6437e6f1d4dfa4d7733b88 2023-07-22 07:07:36,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81bf0c4651ba33729c58f883569df57a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 07:07:36,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f19b253bed6437e6f1d4dfa4d7733b88/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 07:07:36,719 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 81bf0c4651ba33729c58f883569df57a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64971405, jitterRate=-0.03185062110424042}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 07:07:36,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 81bf0c4651ba33729c58f883569df57a: 2023-07-22 07:07:36,719 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f19b253bed6437e6f1d4dfa4d7733b88; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66869491, jitterRate=-0.003566935658454895}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 07:07:36,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f19b253bed6437e6f1d4dfa4d7733b88: 2023-07-22 07:07:36,720 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1690009656215.81bf0c4651ba33729c58f883569df57a., pid=69, masterSystemTime=1690009656696 2023-07-22 07:07:36,720 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656215.f19b253bed6437e6f1d4dfa4d7733b88., pid=70, masterSystemTime=1690009656699 2023-07-22 07:07:36,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1690009656215.81bf0c4651ba33729c58f883569df57a. 2023-07-22 07:07:36,727 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1690009656215.81bf0c4651ba33729c58f883569df57a. 2023-07-22 07:07:36,728 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=81bf0c4651ba33729c58f883569df57a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:36,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656215.f19b253bed6437e6f1d4dfa4d7733b88. 2023-07-22 07:07:36,728 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656215.f19b253bed6437e6f1d4dfa4d7733b88. 2023-07-22 07:07:36,728 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690009656215.81bf0c4651ba33729c58f883569df57a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690009656728"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690009656728"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690009656728"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690009656728"}]},"ts":"1690009656728"} 2023-07-22 07:07:36,729 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=f19b253bed6437e6f1d4dfa4d7733b88, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:36,729 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656215.f19b253bed6437e6f1d4dfa4d7733b88.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690009656729"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690009656729"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690009656729"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690009656729"}]},"ts":"1690009656729"} 2023-07-22 07:07:36,732 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-22 07:07:36,732 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 81bf0c4651ba33729c58f883569df57a, server=jenkins-hbase4.apache.org,43271,1690009574333 in 187 msec 2023-07-22 07:07:36,734 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=81bf0c4651ba33729c58f883569df57a, ASSIGN in 374 msec 2023-07-22 07:07:36,735 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-22 07:07:36,735 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure f19b253bed6437e6f1d4dfa4d7733b88, server=jenkins-hbase4.apache.org,44269,1690009574260 in 185 msec 2023-07-22 07:07:36,737 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-22 07:07:36,737 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f19b253bed6437e6f1d4dfa4d7733b88, ASSIGN in 377 msec 2023-07-22 07:07:36,739 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 07:07:36,739 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690009656739"}]},"ts":"1690009656739"} 2023-07-22 07:07:36,741 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-22 07:07:36,743 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 07:07:36,744 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-22 07:07:36,745 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44269] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-22 07:07:36,747 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:07:36,747 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:07:36,747 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:07:36,747 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:07:36,749 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 07:07:36,749 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-22 07:07:36,751 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 07:07:36,751 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 07:07:36,751 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-22 07:07:36,751 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-22 07:07:36,752 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 07:07:36,752 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-22 07:07:36,752 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 532 msec 2023-07-22 07:07:36,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-22 07:07:36,826 INFO [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-22 07:07:36,849 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions f19b253bed6437e6f1d4dfa4d7733b88, 81bf0c4651ba33729c58f883569df57a 2023-07-22 07:07:36,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[f19b253bed6437e6f1d4dfa4d7733b88, 81bf0c4651ba33729c58f883569df57a], force=true 2023-07-22 07:07:36,865 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[f19b253bed6437e6f1d4dfa4d7733b88, 81bf0c4651ba33729c58f883569df57a], force=true 2023-07-22 07:07:36,865 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[f19b253bed6437e6f1d4dfa4d7733b88, 81bf0c4651ba33729c58f883569df57a], force=true 2023-07-22 07:07:36,865 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[f19b253bed6437e6f1d4dfa4d7733b88, 81bf0c4651ba33729c58f883569df57a], force=true 2023-07-22 07:07:36,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-22 07:07:36,918 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f19b253bed6437e6f1d4dfa4d7733b88, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=81bf0c4651ba33729c58f883569df57a, UNASSIGN}] 2023-07-22 07:07:36,920 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=81bf0c4651ba33729c58f883569df57a, UNASSIGN 2023-07-22 07:07:36,921 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=81bf0c4651ba33729c58f883569df57a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:36,921 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690009656215.81bf0c4651ba33729c58f883569df57a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690009656921"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690009656921"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690009656921"}]},"ts":"1690009656921"} 2023-07-22 07:07:36,927 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f19b253bed6437e6f1d4dfa4d7733b88, UNASSIGN 2023-07-22 07:07:36,928 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure 81bf0c4651ba33729c58f883569df57a, server=jenkins-hbase4.apache.org,43271,1690009574333}] 2023-07-22 07:07:36,928 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=f19b253bed6437e6f1d4dfa4d7733b88, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:36,928 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656215.f19b253bed6437e6f1d4dfa4d7733b88.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690009656928"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690009656928"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690009656928"}]},"ts":"1690009656928"} 2023-07-22 07:07:36,931 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure f19b253bed6437e6f1d4dfa4d7733b88, server=jenkins-hbase4.apache.org,44269,1690009574260}] 2023-07-22 07:07:36,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-22 07:07:37,081 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 81bf0c4651ba33729c58f883569df57a 2023-07-22 07:07:37,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 81bf0c4651ba33729c58f883569df57a, disabling compactions & flushes 2023-07-22 07:07:37,083 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690009656215.81bf0c4651ba33729c58f883569df57a. 2023-07-22 07:07:37,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690009656215.81bf0c4651ba33729c58f883569df57a. 2023-07-22 07:07:37,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690009656215.81bf0c4651ba33729c58f883569df57a. after waiting 0 ms 2023-07-22 07:07:37,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690009656215.81bf0c4651ba33729c58f883569df57a. 2023-07-22 07:07:37,083 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 81bf0c4651ba33729c58f883569df57a 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-22 07:07:37,084 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f19b253bed6437e6f1d4dfa4d7733b88 2023-07-22 07:07:37,085 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f19b253bed6437e6f1d4dfa4d7733b88, disabling compactions & flushes 2023-07-22 07:07:37,085 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656215.f19b253bed6437e6f1d4dfa4d7733b88. 2023-07-22 07:07:37,085 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656215.f19b253bed6437e6f1d4dfa4d7733b88. 2023-07-22 07:07:37,085 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656215.f19b253bed6437e6f1d4dfa4d7733b88. after waiting 0 ms 2023-07-22 07:07:37,085 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656215.f19b253bed6437e6f1d4dfa4d7733b88. 2023-07-22 07:07:37,085 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing f19b253bed6437e6f1d4dfa4d7733b88 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-22 07:07:37,119 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81bf0c4651ba33729c58f883569df57a/.tmp/cf/222b05a732a74a48967ddcd9749626d8 2023-07-22 07:07:37,122 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f19b253bed6437e6f1d4dfa4d7733b88/.tmp/cf/aa9c6d7e41ae474ba0082cdb75739e43 2023-07-22 07:07:37,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81bf0c4651ba33729c58f883569df57a/.tmp/cf/222b05a732a74a48967ddcd9749626d8 as hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81bf0c4651ba33729c58f883569df57a/cf/222b05a732a74a48967ddcd9749626d8 2023-07-22 07:07:37,132 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81bf0c4651ba33729c58f883569df57a/cf/222b05a732a74a48967ddcd9749626d8, entries=1, sequenceid=5, filesize=4.7 K 2023-07-22 07:07:37,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f19b253bed6437e6f1d4dfa4d7733b88/.tmp/cf/aa9c6d7e41ae474ba0082cdb75739e43 as hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f19b253bed6437e6f1d4dfa4d7733b88/cf/aa9c6d7e41ae474ba0082cdb75739e43 2023-07-22 07:07:37,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 81bf0c4651ba33729c58f883569df57a in 50ms, sequenceid=5, compaction requested=false 2023-07-22 07:07:37,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-22 07:07:37,151 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f19b253bed6437e6f1d4dfa4d7733b88/cf/aa9c6d7e41ae474ba0082cdb75739e43, entries=1, sequenceid=5, filesize=4.7 K 2023-07-22 07:07:37,159 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for f19b253bed6437e6f1d4dfa4d7733b88 in 74ms, sequenceid=5, compaction requested=false 2023-07-22 07:07:37,163 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81bf0c4651ba33729c58f883569df57a/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-22 07:07:37,166 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 07:07:37,166 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1690009656215.81bf0c4651ba33729c58f883569df57a. 2023-07-22 07:07:37,166 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 81bf0c4651ba33729c58f883569df57a: 2023-07-22 07:07:37,174 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f19b253bed6437e6f1d4dfa4d7733b88/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-22 07:07:37,175 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 81bf0c4651ba33729c58f883569df57a 2023-07-22 07:07:37,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 07:07:37,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656215.f19b253bed6437e6f1d4dfa4d7733b88. 2023-07-22 07:07:37,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f19b253bed6437e6f1d4dfa4d7733b88: 2023-07-22 07:07:37,176 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=81bf0c4651ba33729c58f883569df57a, regionState=CLOSED 2023-07-22 07:07:37,176 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690009656215.81bf0c4651ba33729c58f883569df57a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690009657176"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690009657176"}]},"ts":"1690009657176"} 2023-07-22 07:07:37,177 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f19b253bed6437e6f1d4dfa4d7733b88 2023-07-22 07:07:37,178 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=f19b253bed6437e6f1d4dfa4d7733b88, regionState=CLOSED 2023-07-22 07:07:37,178 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656215.f19b253bed6437e6f1d4dfa4d7733b88.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690009657178"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690009657178"}]},"ts":"1690009657178"} 2023-07-22 07:07:37,181 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-22 07:07:37,181 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure 81bf0c4651ba33729c58f883569df57a, server=jenkins-hbase4.apache.org,43271,1690009574333 in 251 msec 2023-07-22 07:07:37,183 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=81bf0c4651ba33729c58f883569df57a, UNASSIGN in 263 msec 2023-07-22 07:07:37,183 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=72 2023-07-22 07:07:37,183 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure f19b253bed6437e6f1d4dfa4d7733b88, server=jenkins-hbase4.apache.org,44269,1690009574260 in 250 msec 2023-07-22 07:07:37,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-22 07:07:37,187 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-22 07:07:37,187 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f19b253bed6437e6f1d4dfa4d7733b88, UNASSIGN in 269 msec 2023-07-22 07:07:37,281 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df0288e57a8fdeb48f1fe08ad880e7e5/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-22 07:07:37,285 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656215.f19b253bed6437e6f1d4dfa4d7733b88.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-22 07:07:37,285 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690009656215.81bf0c4651ba33729c58f883569df57a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-22 07:07:37,285 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656216.df0288e57a8fdeb48f1fe08ad880e7e5.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-22 07:07:37,351 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=df0288e57a8fdeb48f1fe08ad880e7e5, ASSIGN}] 2023-07-22 07:07:37,351 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=df0288e57a8fdeb48f1fe08ad880e7e5, ASSIGN 2023-07-22 07:07:37,352 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=df0288e57a8fdeb48f1fe08ad880e7e5, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,44269,1690009574260; forceNewPlan=false, retain=false 2023-07-22 07:07:37,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-22 07:07:37,502 INFO [jenkins-hbase4:44609] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-22 07:07:37,505 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=df0288e57a8fdeb48f1fe08ad880e7e5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:37,505 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656216.df0288e57a8fdeb48f1fe08ad880e7e5.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690009657505"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690009657505"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690009657505"}]},"ts":"1690009657505"} 2023-07-22 07:07:37,507 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure df0288e57a8fdeb48f1fe08ad880e7e5, server=jenkins-hbase4.apache.org,44269,1690009574260}] 2023-07-22 07:07:37,665 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656216.df0288e57a8fdeb48f1fe08ad880e7e5. 2023-07-22 07:07:37,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => df0288e57a8fdeb48f1fe08ad880e7e5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656216.df0288e57a8fdeb48f1fe08ad880e7e5.', STARTKEY => '', ENDKEY => ''} 2023-07-22 07:07:37,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656216.df0288e57a8fdeb48f1fe08ad880e7e5. service=AccessControlService 2023-07-22 07:07:37,666 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 07:07:37,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 df0288e57a8fdeb48f1fe08ad880e7e5 2023-07-22 07:07:37,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656216.df0288e57a8fdeb48f1fe08ad880e7e5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 07:07:37,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for df0288e57a8fdeb48f1fe08ad880e7e5 2023-07-22 07:07:37,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for df0288e57a8fdeb48f1fe08ad880e7e5 2023-07-22 07:07:37,667 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df0288e57a8fdeb48f1fe08ad880e7e5/.regioninfo 2023-07-22 07:07:37,680 INFO [StoreOpener-df0288e57a8fdeb48f1fe08ad880e7e5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region df0288e57a8fdeb48f1fe08ad880e7e5 2023-07-22 07:07:37,681 DEBUG [StoreOpener-df0288e57a8fdeb48f1fe08ad880e7e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df0288e57a8fdeb48f1fe08ad880e7e5/cf 2023-07-22 07:07:37,681 DEBUG [StoreOpener-df0288e57a8fdeb48f1fe08ad880e7e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df0288e57a8fdeb48f1fe08ad880e7e5/cf 2023-07-22 07:07:37,682 INFO [StoreOpener-df0288e57a8fdeb48f1fe08ad880e7e5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region df0288e57a8fdeb48f1fe08ad880e7e5 columnFamilyName cf 2023-07-22 07:07:37,721 DEBUG [StoreOpener-df0288e57a8fdeb48f1fe08ad880e7e5-1] regionserver.HStore(539): loaded hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df0288e57a8fdeb48f1fe08ad880e7e5/cf/222b05a732a74a48967ddcd9749626d8.81bf0c4651ba33729c58f883569df57a->hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81bf0c4651ba33729c58f883569df57a/cf/222b05a732a74a48967ddcd9749626d8-top 2023-07-22 07:07:37,727 DEBUG [StoreOpener-df0288e57a8fdeb48f1fe08ad880e7e5-1] regionserver.HStore(539): loaded hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df0288e57a8fdeb48f1fe08ad880e7e5/cf/aa9c6d7e41ae474ba0082cdb75739e43.f19b253bed6437e6f1d4dfa4d7733b88->hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f19b253bed6437e6f1d4dfa4d7733b88/cf/aa9c6d7e41ae474ba0082cdb75739e43-top 2023-07-22 07:07:37,728 INFO [StoreOpener-df0288e57a8fdeb48f1fe08ad880e7e5-1] regionserver.HStore(310): Store=df0288e57a8fdeb48f1fe08ad880e7e5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 07:07:37,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df0288e57a8fdeb48f1fe08ad880e7e5 2023-07-22 07:07:37,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df0288e57a8fdeb48f1fe08ad880e7e5 2023-07-22 07:07:37,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for df0288e57a8fdeb48f1fe08ad880e7e5 2023-07-22 07:07:37,737 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened df0288e57a8fdeb48f1fe08ad880e7e5; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69778842, jitterRate=0.03978577256202698}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 07:07:37,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for df0288e57a8fdeb48f1fe08ad880e7e5: 2023-07-22 07:07:37,738 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656216.df0288e57a8fdeb48f1fe08ad880e7e5., pid=77, masterSystemTime=1690009657661 2023-07-22 07:07:37,739 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656216.df0288e57a8fdeb48f1fe08ad880e7e5.,because compaction is disabled. 2023-07-22 07:07:37,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656216.df0288e57a8fdeb48f1fe08ad880e7e5. 2023-07-22 07:07:37,741 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656216.df0288e57a8fdeb48f1fe08ad880e7e5. 2023-07-22 07:07:37,741 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=df0288e57a8fdeb48f1fe08ad880e7e5, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:37,742 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656216.df0288e57a8fdeb48f1fe08ad880e7e5.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690009657741"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690009657741"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690009657741"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690009657741"}]},"ts":"1690009657741"} 2023-07-22 07:07:37,745 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-22 07:07:37,745 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure df0288e57a8fdeb48f1fe08ad880e7e5, server=jenkins-hbase4.apache.org,44269,1690009574260 in 236 msec 2023-07-22 07:07:37,749 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-22 07:07:37,749 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=df0288e57a8fdeb48f1fe08ad880e7e5, ASSIGN in 395 msec 2023-07-22 07:07:37,751 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[f19b253bed6437e6f1d4dfa4d7733b88, 81bf0c4651ba33729c58f883569df57a], force=true in 895 msec 2023-07-22 07:07:37,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-22 07:07:37,987 INFO [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-22 07:07:37,990 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-22 07:07:37,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690009657990 (current time:1690009657990). 2023-07-22 07:07:37,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 07:07:37,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(139): Connect 0x5bce078c to 127.0.0.1:63277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 07:07:38,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d51c3fc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 07:07:38,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 07:07:38,010 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44280, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 07:07:38,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5bce078c to 127.0.0.1:63277 2023-07-22 07:07:38,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 07:07:38,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(139): Connect 0x1043a97a to 127.0.0.1:63277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 07:07:38,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b1a2e99, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 07:07:38,019 DEBUG [hconnection-0x58374425-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 07:07:38,022 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44296, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 07:07:38,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 07:07:38,029 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49772, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 07:07:38,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1043a97a to 127.0.0.1:63277 2023-07-22 07:07:38,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 07:07:38,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-22 07:07:38,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 07:07:38,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-22 07:07:38,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-22 07:07:38,035 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-22 07:07:38,035 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1690010258035 2023-07-22 07:07:38,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-22 07:07:38,036 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,036 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 07:07:38,040 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 07:07:38,046 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-22 07:07:38,047 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-22 07:07:38,049 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 14 msec 2023-07-22 07:07:38,051 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-22 07:07:38,055 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1690010258055 2023-07-22 07:07:38,079 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,079 INFO [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-22 07:07:38,079 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:07:38,081 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-22 07:07:38,081 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-22 07:07:38,082 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,082 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,084 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:38,084 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:07:38,084 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:07:38,084 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:07:38,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:07:38,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:07:38,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:07:38,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:07:38,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:07:38,085 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:38,085 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 07:07:38,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:07:38,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,086 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,086 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,086 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-22 07:07:38,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-22 07:07:38,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,086 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-22 07:07:38,086 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-22 07:07:38,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-22 07:07:38,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,087 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-22 07:07:38,087 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,087 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-22 07:07:38,087 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:07:38,088 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,089 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-22 07:07:38,090 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-22 07:07:38,090 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:07:38,090 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,091 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-22 07:07:38,091 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-22 07:07:38,091 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-22 07:07:38,091 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34707,1690009574173' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-22 07:07:38,090 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-22 07:07:38,091 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:07:38,091 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43271,1690009574333' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-22 07:07:38,093 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-22 07:07:38,093 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-22 07:07:38,093 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44269,1690009574260' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-22 07:07:38,095 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,095 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,095 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,095 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 07:07:38,096 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,096 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,096 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 07:07:38,097 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:38,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:38,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:07:38,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:07:38,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:07:38,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:07:38,098 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,098 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 07:07:38,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:38,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:38,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:38,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:07:38,110 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44269,1690009574260' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-22 07:07:38,110 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a931eda[Count = 0] remaining members to acquire global barrier 2023-07-22 07:07:38,110 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-22 07:07:38,110 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,111 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,111 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,112 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-22 07:07:38,112 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-22 07:07:38,112 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-22 07:07:38,112 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,43271,1690009574333' in zk 2023-07-22 07:07:38,112 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 07:07:38,112 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 07:07:38,112 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:38,112 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 07:07:38,112 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656216.df0288e57a8fdeb48f1fe08ad880e7e5. 2023-07-22 07:07:38,112 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656216.df0288e57a8fdeb48f1fe08ad880e7e5. started... 2023-07-22 07:07:38,115 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for df0288e57a8fdeb48f1fe08ad880e7e5: 2023-07-22 07:07:38,115 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,122 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656216.df0288e57a8fdeb48f1fe08ad880e7e5.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,122 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 07:07:38,122 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-22 07:07:38,122 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:07:38,122 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-22 07:07:38,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,122 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df0288e57a8fdeb48f1fe08ad880e7e5/cf/222b05a732a74a48967ddcd9749626d8.81bf0c4651ba33729c58f883569df57a->hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81bf0c4651ba33729c58f883569df57a/cf/222b05a732a74a48967ddcd9749626d8-top, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df0288e57a8fdeb48f1fe08ad880e7e5/cf/aa9c6d7e41ae474ba0082cdb75739e43.f19b253bed6437e6f1d4dfa4d7733b88->hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f19b253bed6437e6f1d4dfa4d7733b88/cf/aa9c6d7e41ae474ba0082cdb75739e43-top] hfiles 2023-07-22 07:07:38,122 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-22 07:07:38,122 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-22 07:07:38,122 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df0288e57a8fdeb48f1fe08ad880e7e5/cf/222b05a732a74a48967ddcd9749626d8.81bf0c4651ba33729c58f883569df57a for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,123 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,34707,1690009574173' in zk 2023-07-22 07:07:38,125 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df0288e57a8fdeb48f1fe08ad880e7e5/cf/aa9c6d7e41ae474ba0082cdb75739e43.f19b253bed6437e6f1d4dfa4d7733b88 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,127 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-22 07:07:38,127 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:07:38,127 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-22 07:07:38,141 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 07:07:38,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-22 07:07:38,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-22 07:07:38,142 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 07:07:38,156 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656216.df0288e57a8fdeb48f1fe08ad880e7e5. completed. 2023-07-22 07:07:38,156 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656216.df0288e57a8fdeb48f1fe08ad880e7e5. 2023-07-22 07:07:38,157 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 07:07:38,157 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 07:07:38,157 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:38,157 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-22 07:07:38,157 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,44269,1690009574260' in zk 2023-07-22 07:07:38,162 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-22 07:07:38,162 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:38,162 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:07:38,162 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-22 07:07:38,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:38,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:07:38,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:07:38,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:07:38,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:07:38,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:38,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:38,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:38,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:07:38,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:38,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:38,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:38,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,44269,1690009574260': 2023-07-22 07:07:38,166 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44269,1690009574260' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-22 07:07:38,166 INFO [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-22 07:07:38,166 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 07:07:38,166 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 07:07:38,166 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,166 INFO [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 07:07:38,176 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,176 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,176 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,176 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,176 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:07:38,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,176 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:07:38,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:07:38,177 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:38,176 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:07:38,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:07:38,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:07:38,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:07:38,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:07:38,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:07:38,177 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:38,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:07:38,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:07:38,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:07:38,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,178 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:38,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:07:38,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:38,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:38,179 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:38,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:38,180 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:38,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:07:38,180 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:38,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:38,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:38,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:38,183 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:38,183 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,183 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:38,183 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:07:38,183 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:38,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:07:38,183 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:07:38,183 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,183 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:07:38,183 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:07:38,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:07:38,183 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:07:38,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:07:38,183 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:07:38,184 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:07:38,183 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,184 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:38,184 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:07:38,184 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:38,184 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:38,184 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,184 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:07:38,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:07:38,184 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:07:38,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:07:38,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:07:38,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:07:38,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:07:38,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:07:38,185 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,237 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,277 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690009582157_0004_000001 (auth:SIMPLE) 2023-07-22 07:07:38,291 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-22 07:07:38,291 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,291 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,291 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1690009658036Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690009658183 (+147 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690009658184 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690009658194 (+10 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690009658228 (+34 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1690009658291 (+63 ms) 2023-07-22 07:07:38,295 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-22 07:07:38,304 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 255 msec 2023-07-22 07:07:38,342 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 07:07:38,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-22 07:07:38,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 07:07:38,344 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009658344 2023-07-22 07:07:38,344 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45491, tgtDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009658344, rawTgtDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009658344, srcFsUri=hdfs://localhost:45491, srcDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03 2023-07-22 07:07:38,372 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45491, inputRoot=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03 2023-07-22 07:07:38,372 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_179482609_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009658344, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009658344/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,372 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45491, inputRoot=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03, snapshotDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-22 07:07:38,382 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009658344/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:38,415 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:38,415 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:38,416 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:38,416 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:38,416 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:38,417 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:38,417 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:38,500 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/hadoop-5971025064852416545.jar 2023-07-22 07:07:38,500 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:38,501 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:38,502 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:38,502 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:38,502 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:38,503 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:38,503 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-22 07:07:38,503 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-22 07:07:38,504 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-22 07:07:38,505 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-22 07:07:38,505 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-22 07:07:38,508 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-22 07:07:38,508 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-22 07:07:38,509 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-22 07:07:38,509 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-22 07:07:38,510 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-22 07:07:38,511 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 07:07:38,511 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 07:07:38,512 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 07:07:38,512 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 07:07:38,512 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 07:07:38,513 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 07:07:38,514 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 07:07:39,189 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 07:07:39,735 WARN [Listener at jenkins-hbase4.apache.org/45401] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-22 07:07:39,740 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-22 07:07:39,742 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-22 07:07:39,830 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 07:07:39,830 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 07:07:40,312 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690009582157_0005_000001 (auth:SIMPLE) 2023-07-22 07:07:46,947 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690009582157_0005_000001 (auth:SIMPLE) 2023-07-22 07:07:49,307 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690009582157_0005_000001 (auth:SIMPLE) 2023-07-22 07:07:53,018 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690009582157_0005_000001 (auth:SIMPLE) 2023-07-22 07:07:55,015 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-22 07:07:55,027 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-22 07:07:55,050 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:55,050 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-22 07:07:55,051 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-22 07:07:55,051 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_663023864_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:55,051 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(367): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-22 07:07:55,051 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(367): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-22 07:07:55,051 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_663023864_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009658344/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009658344/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:55,052 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(367): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009658344/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-22 07:07:55,052 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(367): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009658344/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-22 07:07:55,060 INFO [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:55,061 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:55,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:55,066 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690009675066"}]},"ts":"1690009675066"} 2023-07-22 07:07:55,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-22 07:07:55,072 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-22 07:07:55,073 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-22 07:07:55,074 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=df0288e57a8fdeb48f1fe08ad880e7e5, UNASSIGN}] 2023-07-22 07:07:55,075 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=df0288e57a8fdeb48f1fe08ad880e7e5, UNASSIGN 2023-07-22 07:07:55,075 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=df0288e57a8fdeb48f1fe08ad880e7e5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:55,076 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656216.df0288e57a8fdeb48f1fe08ad880e7e5.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690009675075"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690009675075"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690009675075"}]},"ts":"1690009675075"} 2023-07-22 07:07:55,077 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure df0288e57a8fdeb48f1fe08ad880e7e5, server=jenkins-hbase4.apache.org,44269,1690009574260}] 2023-07-22 07:07:55,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-22 07:07:55,228 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close df0288e57a8fdeb48f1fe08ad880e7e5 2023-07-22 07:07:55,229 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing df0288e57a8fdeb48f1fe08ad880e7e5, disabling compactions & flushes 2023-07-22 07:07:55,229 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656216.df0288e57a8fdeb48f1fe08ad880e7e5. 2023-07-22 07:07:55,229 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656216.df0288e57a8fdeb48f1fe08ad880e7e5. 2023-07-22 07:07:55,229 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656216.df0288e57a8fdeb48f1fe08ad880e7e5. after waiting 0 ms 2023-07-22 07:07:55,229 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656216.df0288e57a8fdeb48f1fe08ad880e7e5. 2023-07-22 07:07:55,244 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df0288e57a8fdeb48f1fe08ad880e7e5/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-22 07:07:55,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 07:07:55,247 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656216.df0288e57a8fdeb48f1fe08ad880e7e5. 2023-07-22 07:07:55,247 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for df0288e57a8fdeb48f1fe08ad880e7e5: 2023-07-22 07:07:55,250 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed df0288e57a8fdeb48f1fe08ad880e7e5 2023-07-22 07:07:55,250 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=df0288e57a8fdeb48f1fe08ad880e7e5, regionState=CLOSED 2023-07-22 07:07:55,251 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656216.df0288e57a8fdeb48f1fe08ad880e7e5.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690009675250"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690009675250"}]},"ts":"1690009675250"} 2023-07-22 07:07:55,259 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-22 07:07:55,259 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure df0288e57a8fdeb48f1fe08ad880e7e5, server=jenkins-hbase4.apache.org,44269,1690009574260 in 180 msec 2023-07-22 07:07:55,263 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-22 07:07:55,263 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=df0288e57a8fdeb48f1fe08ad880e7e5, UNASSIGN in 185 msec 2023-07-22 07:07:55,263 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690009675263"}]},"ts":"1690009675263"} 2023-07-22 07:07:55,269 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-22 07:07:55,271 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-22 07:07:55,273 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 210 msec 2023-07-22 07:07:55,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-22 07:07:55,369 INFO [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-22 07:07:55,370 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:55,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:55,378 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:55,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:55,379 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:55,381 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44269] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:55,385 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df0288e57a8fdeb48f1fe08ad880e7e5 2023-07-22 07:07:55,385 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81bf0c4651ba33729c58f883569df57a 2023-07-22 07:07:55,385 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f19b253bed6437e6f1d4dfa4d7733b88 2023-07-22 07:07:55,387 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df0288e57a8fdeb48f1fe08ad880e7e5/cf, FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df0288e57a8fdeb48f1fe08ad880e7e5/recovered.edits] 2023-07-22 07:07:55,387 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f19b253bed6437e6f1d4dfa4d7733b88/cf, FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f19b253bed6437e6f1d4dfa4d7733b88/recovered.edits] 2023-07-22 07:07:55,388 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81bf0c4651ba33729c58f883569df57a/cf, FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81bf0c4651ba33729c58f883569df57a/recovered.edits] 2023-07-22 07:07:55,388 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:55,388 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:55,388 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:55,389 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:55,389 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-22 07:07:55,389 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-22 07:07:55,389 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-22 07:07:55,389 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-22 07:07:55,390 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:55,390 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:55,390 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:55,390 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:07:55,390 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:07:55,390 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:55,391 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:07:55,390 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:07:55,392 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 07:07:55,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-22 07:07:55,392 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 07:07:55,392 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 07:07:55,392 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 07:07:55,395 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81bf0c4651ba33729c58f883569df57a/cf/222b05a732a74a48967ddcd9749626d8 to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81bf0c4651ba33729c58f883569df57a/cf/222b05a732a74a48967ddcd9749626d8 2023-07-22 07:07:55,396 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df0288e57a8fdeb48f1fe08ad880e7e5/cf/222b05a732a74a48967ddcd9749626d8.81bf0c4651ba33729c58f883569df57a to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df0288e57a8fdeb48f1fe08ad880e7e5/cf/222b05a732a74a48967ddcd9749626d8.81bf0c4651ba33729c58f883569df57a 2023-07-22 07:07:55,399 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df0288e57a8fdeb48f1fe08ad880e7e5/cf/aa9c6d7e41ae474ba0082cdb75739e43.f19b253bed6437e6f1d4dfa4d7733b88 to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df0288e57a8fdeb48f1fe08ad880e7e5/cf/aa9c6d7e41ae474ba0082cdb75739e43.f19b253bed6437e6f1d4dfa4d7733b88 2023-07-22 07:07:55,401 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81bf0c4651ba33729c58f883569df57a/recovered.edits/8.seqid to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81bf0c4651ba33729c58f883569df57a/recovered.edits/8.seqid 2023-07-22 07:07:55,402 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f19b253bed6437e6f1d4dfa4d7733b88/cf/aa9c6d7e41ae474ba0082cdb75739e43 to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f19b253bed6437e6f1d4dfa4d7733b88/cf/aa9c6d7e41ae474ba0082cdb75739e43 2023-07-22 07:07:55,402 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81bf0c4651ba33729c58f883569df57a 2023-07-22 07:07:55,405 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df0288e57a8fdeb48f1fe08ad880e7e5/recovered.edits/12.seqid to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df0288e57a8fdeb48f1fe08ad880e7e5/recovered.edits/12.seqid 2023-07-22 07:07:55,415 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df0288e57a8fdeb48f1fe08ad880e7e5 2023-07-22 07:07:55,417 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f19b253bed6437e6f1d4dfa4d7733b88/recovered.edits/8.seqid to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f19b253bed6437e6f1d4dfa4d7733b88/recovered.edits/8.seqid 2023-07-22 07:07:55,417 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f19b253bed6437e6f1d4dfa4d7733b88 2023-07-22 07:07:55,418 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-22 07:07:55,427 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:55,430 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-22 07:07:55,441 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-22 07:07:55,443 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:55,443 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-22 07:07:55,443 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656216.df0288e57a8fdeb48f1fe08ad880e7e5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690009675443"}]},"ts":"9223372036854775807"} 2023-07-22 07:07:55,445 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-22 07:07:55,445 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => df0288e57a8fdeb48f1fe08ad880e7e5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690009656216.df0288e57a8fdeb48f1fe08ad880e7e5.', STARTKEY => '', ENDKEY => ''}] 2023-07-22 07:07:55,445 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-22 07:07:55,445 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690009675445"}]},"ts":"9223372036854775807"} 2023-07-22 07:07:55,449 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-22 07:07:55,454 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:55,457 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 84 msec 2023-07-22 07:07:55,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-22 07:07:55,494 INFO [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-22 07:07:55,494 INFO [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:55,495 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:55,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:55,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-22 07:07:55,507 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690009675507"}]},"ts":"1690009675507"} 2023-07-22 07:07:55,511 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-22 07:07:55,514 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-22 07:07:55,523 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9a0f873965896b6b680aad1a79f865a6, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3a9fca8ee9bae6ca766b26c91bfc1c7d, UNASSIGN}] 2023-07-22 07:07:55,526 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3a9fca8ee9bae6ca766b26c91bfc1c7d, UNASSIGN 2023-07-22 07:07:55,530 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9a0f873965896b6b680aad1a79f865a6, UNASSIGN 2023-07-22 07:07:55,530 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=3a9fca8ee9bae6ca766b26c91bfc1c7d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:55,531 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690009654022.3a9fca8ee9bae6ca766b26c91bfc1c7d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690009675530"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690009675530"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690009675530"}]},"ts":"1690009675530"} 2023-07-22 07:07:55,531 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=9a0f873965896b6b680aad1a79f865a6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:55,531 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690009654022.9a0f873965896b6b680aad1a79f865a6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690009675531"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690009675531"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690009675531"}]},"ts":"1690009675531"} 2023-07-22 07:07:55,533 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure 3a9fca8ee9bae6ca766b26c91bfc1c7d, server=jenkins-hbase4.apache.org,34707,1690009574173}] 2023-07-22 07:07:55,537 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure 9a0f873965896b6b680aad1a79f865a6, server=jenkins-hbase4.apache.org,44269,1690009574260}] 2023-07-22 07:07:55,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-22 07:07:55,688 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3a9fca8ee9bae6ca766b26c91bfc1c7d 2023-07-22 07:07:55,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3a9fca8ee9bae6ca766b26c91bfc1c7d, disabling compactions & flushes 2023-07-22 07:07:55,688 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1690009654022.3a9fca8ee9bae6ca766b26c91bfc1c7d. 2023-07-22 07:07:55,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690009654022.3a9fca8ee9bae6ca766b26c91bfc1c7d. 2023-07-22 07:07:55,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690009654022.3a9fca8ee9bae6ca766b26c91bfc1c7d. after waiting 0 ms 2023-07-22 07:07:55,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1690009654022.3a9fca8ee9bae6ca766b26c91bfc1c7d. 2023-07-22 07:07:55,693 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9a0f873965896b6b680aad1a79f865a6 2023-07-22 07:07:55,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9a0f873965896b6b680aad1a79f865a6, disabling compactions & flushes 2023-07-22 07:07:55,693 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1690009654022.9a0f873965896b6b680aad1a79f865a6. 2023-07-22 07:07:55,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690009654022.9a0f873965896b6b680aad1a79f865a6. 2023-07-22 07:07:55,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690009654022.9a0f873965896b6b680aad1a79f865a6. after waiting 0 ms 2023-07-22 07:07:55,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1690009654022.9a0f873965896b6b680aad1a79f865a6. 2023-07-22 07:07:55,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a9fca8ee9bae6ca766b26c91bfc1c7d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 07:07:55,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 07:07:55,701 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1690009654022.3a9fca8ee9bae6ca766b26c91bfc1c7d. 2023-07-22 07:07:55,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3a9fca8ee9bae6ca766b26c91bfc1c7d: 2023-07-22 07:07:55,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithMergeRegion/9a0f873965896b6b680aad1a79f865a6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 07:07:55,702 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3a9fca8ee9bae6ca766b26c91bfc1c7d 2023-07-22 07:07:55,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 07:07:55,704 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1690009654022.9a0f873965896b6b680aad1a79f865a6. 2023-07-22 07:07:55,704 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9a0f873965896b6b680aad1a79f865a6: 2023-07-22 07:07:55,704 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=3a9fca8ee9bae6ca766b26c91bfc1c7d, regionState=CLOSED 2023-07-22 07:07:55,704 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690009654022.3a9fca8ee9bae6ca766b26c91bfc1c7d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690009675704"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690009675704"}]},"ts":"1690009675704"} 2023-07-22 07:07:55,705 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9a0f873965896b6b680aad1a79f865a6 2023-07-22 07:07:55,706 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=9a0f873965896b6b680aad1a79f865a6, regionState=CLOSED 2023-07-22 07:07:55,706 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690009654022.9a0f873965896b6b680aad1a79f865a6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690009675706"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690009675706"}]},"ts":"1690009675706"} 2023-07-22 07:07:55,710 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-22 07:07:55,710 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure 3a9fca8ee9bae6ca766b26c91bfc1c7d, server=jenkins-hbase4.apache.org,34707,1690009574173 in 174 msec 2023-07-22 07:07:55,711 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-22 07:07:55,711 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure 9a0f873965896b6b680aad1a79f865a6, server=jenkins-hbase4.apache.org,44269,1690009574260 in 172 msec 2023-07-22 07:07:55,712 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3a9fca8ee9bae6ca766b26c91bfc1c7d, UNASSIGN in 187 msec 2023-07-22 07:07:55,713 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-22 07:07:55,713 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9a0f873965896b6b680aad1a79f865a6, UNASSIGN in 188 msec 2023-07-22 07:07:55,714 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690009675714"}]},"ts":"1690009675714"} 2023-07-22 07:07:55,715 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-22 07:07:55,717 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-22 07:07:55,718 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 222 msec 2023-07-22 07:07:55,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-22 07:07:55,804 INFO [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-22 07:07:55,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:55,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:55,808 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:55,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:55,809 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:55,811 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44269] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:55,813 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:55,813 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:55,813 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:55,813 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-22 07:07:55,814 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-22 07:07:55,814 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-22 07:07:55,814 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9a0f873965896b6b680aad1a79f865a6 2023-07-22 07:07:55,814 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a9fca8ee9bae6ca766b26c91bfc1c7d 2023-07-22 07:07:55,816 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9a0f873965896b6b680aad1a79f865a6/cf, FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9a0f873965896b6b680aad1a79f865a6/recovered.edits] 2023-07-22 07:07:55,817 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:55,817 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a9fca8ee9bae6ca766b26c91bfc1c7d/cf, FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a9fca8ee9bae6ca766b26c91bfc1c7d/recovered.edits] 2023-07-22 07:07:55,819 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:55,819 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:07:55,819 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:07:55,819 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:55,819 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:07:55,819 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-07-22 07:07:55,819 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:55,819 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:07:55,819 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-22 07:07:55,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-22 07:07:55,821 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9a0f873965896b6b680aad1a79f865a6/cf/060d5ca5c1d04bc08bb18d9554d2a223 to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/9a0f873965896b6b680aad1a79f865a6/cf/060d5ca5c1d04bc08bb18d9554d2a223 2023-07-22 07:07:55,821 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a9fca8ee9bae6ca766b26c91bfc1c7d/cf/70436799deaa40d2aa1942d0ed53b8b4 to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a9fca8ee9bae6ca766b26c91bfc1c7d/cf/70436799deaa40d2aa1942d0ed53b8b4 2023-07-22 07:07:55,825 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a9fca8ee9bae6ca766b26c91bfc1c7d/recovered.edits/9.seqid to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a9fca8ee9bae6ca766b26c91bfc1c7d/recovered.edits/9.seqid 2023-07-22 07:07:55,825 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9a0f873965896b6b680aad1a79f865a6/recovered.edits/9.seqid to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/9a0f873965896b6b680aad1a79f865a6/recovered.edits/9.seqid 2023-07-22 07:07:55,825 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3a9fca8ee9bae6ca766b26c91bfc1c7d 2023-07-22 07:07:55,825 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9a0f873965896b6b680aad1a79f865a6 2023-07-22 07:07:55,825 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-22 07:07:55,826 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-22 07:07:55,827 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-22 07:07:55,830 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230722510c8f205cd54eb6afbba9d140bcfd13 to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230722510c8f205cd54eb6afbba9d140bcfd13 2023-07-22 07:07:55,831 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230722888058b6d33d46c6aa69b6b11d21ecde to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230722888058b6d33d46c6aa69b6b11d21ecde 2023-07-22 07:07:55,832 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-22 07:07:55,834 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:55,838 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-22 07:07:55,840 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-22 07:07:55,841 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:55,841 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-22 07:07:55,841 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690009654022.9a0f873965896b6b680aad1a79f865a6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690009675841"}]},"ts":"9223372036854775807"} 2023-07-22 07:07:55,841 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690009654022.3a9fca8ee9bae6ca766b26c91bfc1c7d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690009675841"}]},"ts":"9223372036854775807"} 2023-07-22 07:07:55,843 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-22 07:07:55,843 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9a0f873965896b6b680aad1a79f865a6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690009654022.9a0f873965896b6b680aad1a79f865a6.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 3a9fca8ee9bae6ca766b26c91bfc1c7d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690009654022.3a9fca8ee9bae6ca766b26c91bfc1c7d.', STARTKEY => '1', ENDKEY => ''}] 2023-07-22 07:07:55,843 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-22 07:07:55,843 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690009675843"}]},"ts":"9223372036854775807"} 2023-07-22 07:07:55,844 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-22 07:07:55,846 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:55,847 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 41 msec 2023-07-22 07:07:55,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-22 07:07:55,921 INFO [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-22 07:07:55,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-22 07:07:55,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:55,934 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-22 07:07:55,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 07:07:55,937 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-22 07:07:55,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 07:07:55,964 INFO [Listener at jenkins-hbase4.apache.org/45401] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=757 (was 744) Potentially hanging thread: Thread-4108 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6ff205ea-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6ff205ea-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6ff205ea-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2019348091_1 at /127.0.0.1:51890 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-69235523_17 at /127.0.0.1:51916 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_663023864_17 at /127.0.0.1:44504 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6ff205ea-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6ff205ea-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6ff205ea-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1203180535) connection to jenkins-hbase4.apache.org/172.31.14.131:46799 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_663023864_17 at /127.0.0.1:57812 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=905 (was 895) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=437 (was 368) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 181), AvailableMemoryMB=5990 (was 6428) 2023-07-22 07:07:55,964 WARN [Listener at jenkins-hbase4.apache.org/45401] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-07-22 07:07:55,984 INFO [Listener at jenkins-hbase4.apache.org/45401] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=757, OpenFileDescriptor=905, MaxFileDescriptor=60000, SystemLoadAverage=437, ProcessCount=181, AvailableMemoryMB=5990 2023-07-22 07:07:55,984 WARN [Listener at jenkins-hbase4.apache.org/45401] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-07-22 07:07:55,985 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-22 07:07:55,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 07:07:55,988 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 07:07:55,988 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-22 07:07:55,989 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 07:07:55,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-22 07:07:55,991 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testEmptyExportFileSystemState/0821a58334f0aaf2cb810b908a398adb 2023-07-22 07:07:55,991 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testEmptyExportFileSystemState/fda78241bce1b808c191916b7b73a122 2023-07-22 07:07:55,992 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testEmptyExportFileSystemState/0821a58334f0aaf2cb810b908a398adb empty. 2023-07-22 07:07:55,992 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testEmptyExportFileSystemState/fda78241bce1b808c191916b7b73a122 empty. 2023-07-22 07:07:55,992 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testEmptyExportFileSystemState/0821a58334f0aaf2cb810b908a398adb 2023-07-22 07:07:55,993 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testEmptyExportFileSystemState/fda78241bce1b808c191916b7b73a122 2023-07-22 07:07:55,993 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-22 07:07:56,003 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-22 07:07:56,005 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => fda78241bce1b808c191916b7b73a122, NAME => 'testtb-testEmptyExportFileSystemState,1,1690009675985.fda78241bce1b808c191916b7b73a122.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp 2023-07-22 07:07:56,005 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0821a58334f0aaf2cb810b908a398adb, NAME => 'testtb-testEmptyExportFileSystemState,,1690009675985.0821a58334f0aaf2cb810b908a398adb.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp 2023-07-22 07:07:56,028 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1690009675985.0821a58334f0aaf2cb810b908a398adb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 07:07:56,028 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 0821a58334f0aaf2cb810b908a398adb, disabling compactions & flushes 2023-07-22 07:07:56,028 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1690009675985.0821a58334f0aaf2cb810b908a398adb. 2023-07-22 07:07:56,028 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1690009675985.0821a58334f0aaf2cb810b908a398adb. 2023-07-22 07:07:56,028 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1690009675985.0821a58334f0aaf2cb810b908a398adb. after waiting 0 ms 2023-07-22 07:07:56,029 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1690009675985.0821a58334f0aaf2cb810b908a398adb. 2023-07-22 07:07:56,029 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1690009675985.0821a58334f0aaf2cb810b908a398adb. 2023-07-22 07:07:56,029 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 0821a58334f0aaf2cb810b908a398adb: 2023-07-22 07:07:56,029 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1690009675985.fda78241bce1b808c191916b7b73a122.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 07:07:56,029 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing fda78241bce1b808c191916b7b73a122, disabling compactions & flushes 2023-07-22 07:07:56,029 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1690009675985.fda78241bce1b808c191916b7b73a122. 2023-07-22 07:07:56,029 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1690009675985.fda78241bce1b808c191916b7b73a122. 2023-07-22 07:07:56,029 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1690009675985.fda78241bce1b808c191916b7b73a122. after waiting 0 ms 2023-07-22 07:07:56,029 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1690009675985.fda78241bce1b808c191916b7b73a122. 2023-07-22 07:07:56,029 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1690009675985.fda78241bce1b808c191916b7b73a122. 2023-07-22 07:07:56,029 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for fda78241bce1b808c191916b7b73a122: 2023-07-22 07:07:56,031 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 07:07:56,033 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1690009675985.0821a58334f0aaf2cb810b908a398adb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690009676032"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690009676032"}]},"ts":"1690009676032"} 2023-07-22 07:07:56,033 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1690009675985.fda78241bce1b808c191916b7b73a122.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690009676032"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690009676032"}]},"ts":"1690009676032"} 2023-07-22 07:07:56,035 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-22 07:07:56,041 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 07:07:56,041 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690009676041"}]},"ts":"1690009676041"} 2023-07-22 07:07:56,043 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-22 07:07:56,045 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 07:07:56,047 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 07:07:56,047 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 07:07:56,047 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 07:07:56,047 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 07:07:56,047 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0821a58334f0aaf2cb810b908a398adb, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fda78241bce1b808c191916b7b73a122, ASSIGN}] 2023-07-22 07:07:56,050 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0821a58334f0aaf2cb810b908a398adb, ASSIGN 2023-07-22 07:07:56,050 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fda78241bce1b808c191916b7b73a122, ASSIGN 2023-07-22 07:07:56,050 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0821a58334f0aaf2cb810b908a398adb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43271,1690009574333; forceNewPlan=false, retain=false 2023-07-22 07:07:56,050 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fda78241bce1b808c191916b7b73a122, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44269,1690009574260; forceNewPlan=false, retain=false 2023-07-22 07:07:56,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-22 07:07:56,201 INFO [jenkins-hbase4:44609] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-22 07:07:56,204 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=0821a58334f0aaf2cb810b908a398adb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:56,204 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=fda78241bce1b808c191916b7b73a122, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:56,204 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1690009675985.0821a58334f0aaf2cb810b908a398adb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690009676204"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690009676204"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690009676204"}]},"ts":"1690009676204"} 2023-07-22 07:07:56,204 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1690009675985.fda78241bce1b808c191916b7b73a122.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690009676204"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690009676204"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690009676204"}]},"ts":"1690009676204"} 2023-07-22 07:07:56,206 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 0821a58334f0aaf2cb810b908a398adb, server=jenkins-hbase4.apache.org,43271,1690009574333}] 2023-07-22 07:07:56,207 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure fda78241bce1b808c191916b7b73a122, server=jenkins-hbase4.apache.org,44269,1690009574260}] 2023-07-22 07:07:56,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-22 07:07:56,362 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1690009675985.fda78241bce1b808c191916b7b73a122. 2023-07-22 07:07:56,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fda78241bce1b808c191916b7b73a122, NAME => 'testtb-testEmptyExportFileSystemState,1,1690009675985.fda78241bce1b808c191916b7b73a122.', STARTKEY => '1', ENDKEY => ''} 2023-07-22 07:07:56,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1690009675985.fda78241bce1b808c191916b7b73a122. service=AccessControlService 2023-07-22 07:07:56,363 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 07:07:56,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState fda78241bce1b808c191916b7b73a122 2023-07-22 07:07:56,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1690009675985.fda78241bce1b808c191916b7b73a122.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 07:07:56,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fda78241bce1b808c191916b7b73a122 2023-07-22 07:07:56,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fda78241bce1b808c191916b7b73a122 2023-07-22 07:07:56,364 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1690009675985.0821a58334f0aaf2cb810b908a398adb. 2023-07-22 07:07:56,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0821a58334f0aaf2cb810b908a398adb, NAME => 'testtb-testEmptyExportFileSystemState,,1690009675985.0821a58334f0aaf2cb810b908a398adb.', STARTKEY => '', ENDKEY => '1'} 2023-07-22 07:07:56,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1690009675985.0821a58334f0aaf2cb810b908a398adb. service=AccessControlService 2023-07-22 07:07:56,365 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 07:07:56,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 0821a58334f0aaf2cb810b908a398adb 2023-07-22 07:07:56,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1690009675985.0821a58334f0aaf2cb810b908a398adb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 07:07:56,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0821a58334f0aaf2cb810b908a398adb 2023-07-22 07:07:56,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0821a58334f0aaf2cb810b908a398adb 2023-07-22 07:07:56,371 INFO [StoreOpener-0821a58334f0aaf2cb810b908a398adb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0821a58334f0aaf2cb810b908a398adb 2023-07-22 07:07:56,371 INFO [StoreOpener-fda78241bce1b808c191916b7b73a122-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fda78241bce1b808c191916b7b73a122 2023-07-22 07:07:56,374 DEBUG [StoreOpener-fda78241bce1b808c191916b7b73a122-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testEmptyExportFileSystemState/fda78241bce1b808c191916b7b73a122/cf 2023-07-22 07:07:56,374 DEBUG [StoreOpener-0821a58334f0aaf2cb810b908a398adb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testEmptyExportFileSystemState/0821a58334f0aaf2cb810b908a398adb/cf 2023-07-22 07:07:56,374 DEBUG [StoreOpener-fda78241bce1b808c191916b7b73a122-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testEmptyExportFileSystemState/fda78241bce1b808c191916b7b73a122/cf 2023-07-22 07:07:56,374 DEBUG [StoreOpener-0821a58334f0aaf2cb810b908a398adb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testEmptyExportFileSystemState/0821a58334f0aaf2cb810b908a398adb/cf 2023-07-22 07:07:56,374 INFO [StoreOpener-0821a58334f0aaf2cb810b908a398adb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0821a58334f0aaf2cb810b908a398adb columnFamilyName cf 2023-07-22 07:07:56,374 INFO [StoreOpener-fda78241bce1b808c191916b7b73a122-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fda78241bce1b808c191916b7b73a122 columnFamilyName cf 2023-07-22 07:07:56,376 INFO [StoreOpener-fda78241bce1b808c191916b7b73a122-1] regionserver.HStore(310): Store=fda78241bce1b808c191916b7b73a122/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 07:07:56,376 INFO [StoreOpener-0821a58334f0aaf2cb810b908a398adb-1] regionserver.HStore(310): Store=0821a58334f0aaf2cb810b908a398adb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 07:07:56,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testEmptyExportFileSystemState/fda78241bce1b808c191916b7b73a122 2023-07-22 07:07:56,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testEmptyExportFileSystemState/fda78241bce1b808c191916b7b73a122 2023-07-22 07:07:56,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testEmptyExportFileSystemState/0821a58334f0aaf2cb810b908a398adb 2023-07-22 07:07:56,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testEmptyExportFileSystemState/0821a58334f0aaf2cb810b908a398adb 2023-07-22 07:07:56,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fda78241bce1b808c191916b7b73a122 2023-07-22 07:07:56,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0821a58334f0aaf2cb810b908a398adb 2023-07-22 07:07:56,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testEmptyExportFileSystemState/fda78241bce1b808c191916b7b73a122/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 07:07:56,384 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fda78241bce1b808c191916b7b73a122; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74743317, jitterRate=0.11376221477985382}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 07:07:56,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fda78241bce1b808c191916b7b73a122: 2023-07-22 07:07:56,385 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1690009675985.fda78241bce1b808c191916b7b73a122., pid=94, masterSystemTime=1690009676359 2023-07-22 07:07:56,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testEmptyExportFileSystemState/0821a58334f0aaf2cb810b908a398adb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 07:07:56,386 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0821a58334f0aaf2cb810b908a398adb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65676731, jitterRate=-0.021340444684028625}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 07:07:56,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0821a58334f0aaf2cb810b908a398adb: 2023-07-22 07:07:56,386 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1690009675985.0821a58334f0aaf2cb810b908a398adb., pid=93, masterSystemTime=1690009676358 2023-07-22 07:07:56,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1690009675985.fda78241bce1b808c191916b7b73a122. 2023-07-22 07:07:56,387 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1690009675985.fda78241bce1b808c191916b7b73a122. 2023-07-22 07:07:56,387 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=fda78241bce1b808c191916b7b73a122, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:56,388 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1690009675985.fda78241bce1b808c191916b7b73a122.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690009676387"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690009676387"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690009676387"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690009676387"}]},"ts":"1690009676387"} 2023-07-22 07:07:56,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1690009675985.0821a58334f0aaf2cb810b908a398adb. 2023-07-22 07:07:56,388 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1690009675985.0821a58334f0aaf2cb810b908a398adb. 2023-07-22 07:07:56,388 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=0821a58334f0aaf2cb810b908a398adb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:56,389 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1690009675985.0821a58334f0aaf2cb810b908a398adb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690009676388"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690009676388"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690009676388"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690009676388"}]},"ts":"1690009676388"} 2023-07-22 07:07:56,392 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-22 07:07:56,393 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure fda78241bce1b808c191916b7b73a122, server=jenkins-hbase4.apache.org,44269,1690009574260 in 182 msec 2023-07-22 07:07:56,394 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-22 07:07:56,394 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 0821a58334f0aaf2cb810b908a398adb, server=jenkins-hbase4.apache.org,43271,1690009574333 in 185 msec 2023-07-22 07:07:56,394 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fda78241bce1b808c191916b7b73a122, ASSIGN in 346 msec 2023-07-22 07:07:56,396 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-22 07:07:56,396 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0821a58334f0aaf2cb810b908a398adb, ASSIGN in 347 msec 2023-07-22 07:07:56,396 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 07:07:56,397 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690009676396"}]},"ts":"1690009676396"} 2023-07-22 07:07:56,398 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-22 07:07:56,401 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 07:07:56,401 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-22 07:07:56,403 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44269] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-22 07:07:56,404 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:07:56,404 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:07:56,404 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:07:56,404 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:07:56,405 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 07:07:56,405 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 07:07:56,405 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 07:07:56,406 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 07:07:56,407 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 420 msec 2023-07-22 07:07:56,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-22 07:07:56,593 INFO [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-22 07:07:56,595 DEBUG [Listener at jenkins-hbase4.apache.org/45401] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-22 07:07:56,596 DEBUG [Listener at jenkins-hbase4.apache.org/45401] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1690009675985.0821a58334f0aaf2cb810b908a398adb. 2023-07-22 07:07:56,597 INFO [Listener at jenkins-hbase4.apache.org/45401] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 07:07:56,608 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 07:07:56,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690009676608 (current time:1690009676608). 2023-07-22 07:07:56,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 07:07:56,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(139): Connect 0x49e508d1 to 127.0.0.1:63277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 07:07:56,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e8d6e5b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 07:07:56,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 07:07:56,624 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46220, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 07:07:56,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x49e508d1 to 127.0.0.1:63277 2023-07-22 07:07:56,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 07:07:56,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(139): Connect 0x6a66fab8 to 127.0.0.1:63277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 07:07:56,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b24d4a5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 07:07:56,632 DEBUG [hconnection-0x6e3e8c2c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 07:07:56,634 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46222, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 07:07:56,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 07:07:56,640 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38436, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 07:07:56,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a66fab8 to 127.0.0.1:63277 2023-07-22 07:07:56,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 07:07:56,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-22 07:07:56,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 07:07:56,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 07:07:56,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-22 07:07:56,646 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-22 07:07:56,647 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690010276647 2023-07-22 07:07:56,647 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-22 07:07:56,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 07:07:56,649 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 07:07:56,649 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 07:07:56,649 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-22 07:07:56,650 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-22 07:07:56,651 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-22 07:07:56,654 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-22 07:07:56,655 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690010276655 2023-07-22 07:07:56,670 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,671 INFO [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-22 07:07:56,671 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:07:56,672 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-22 07:07:56,672 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-22 07:07:56,673 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,673 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,679 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:07:56,679 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:07:56,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:07:56,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:07:56,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:07:56,679 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:56,679 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:07:56,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:07:56,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:07:56,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:07:56,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,680 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:56,680 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:56,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,680 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,681 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,681 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,681 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:56,681 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 07:07:56,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-22 07:07:56,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-22 07:07:56,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,681 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-22 07:07:56,681 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-22 07:07:56,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-22 07:07:56,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,682 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-22 07:07:56,683 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,683 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,683 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-22 07:07:56,684 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-22 07:07:56,684 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,684 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:07:56,684 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-22 07:07:56,684 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:07:56,684 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:07:56,687 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-22 07:07:56,688 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-22 07:07:56,688 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43271,1690009574333' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-22 07:07:56,685 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-22 07:07:56,688 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-22 07:07:56,688 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-22 07:07:56,688 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-22 07:07:56,688 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34707,1690009574173' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-22 07:07:56,688 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44269,1690009574260' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-22 07:07:56,695 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,695 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,695 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:56,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:56,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:07:56,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:07:56,696 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,696 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,696 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 07:07:56,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:07:56,696 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,696 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 07:07:56,696 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,696 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 07:07:56,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:07:56,697 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:56,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:56,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:56,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:56,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:07:56,698 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44269,1690009574260' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-22 07:07:56,698 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2250dda4[Count = 1] remaining members to acquire global barrier 2023-07-22 07:07:56,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:56,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:07:56,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:07:56,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:07:56,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:07:56,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:56,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:56,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:56,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:07:56,705 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43271,1690009574333' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-22 07:07:56,705 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2250dda4[Count = 0] remaining members to acquire global barrier 2023-07-22 07:07:56,705 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-22 07:07:56,705 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,706 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,706 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,706 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,707 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-22 07:07:56,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,707 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:56,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,707 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-22 07:07:56,707 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-22 07:07:56,707 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34707,1690009574173' in zk 2023-07-22 07:07:56,707 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-22 07:07:56,710 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-22 07:07:56,710 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:07:56,710 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-22 07:07:56,710 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:56,710 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 07:07:56,716 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 07:07:56,716 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 07:07:56,717 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1690009675985.0821a58334f0aaf2cb810b908a398adb. 2023-07-22 07:07:56,717 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690009675985.0821a58334f0aaf2cb810b908a398adb. started... 2023-07-22 07:07:56,717 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0821a58334f0aaf2cb810b908a398adb: 2023-07-22 07:07:56,718 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1690009675985.0821a58334f0aaf2cb810b908a398adb.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,718 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 07:07:56,718 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 07:07:56,727 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 07:07:56,727 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1690009675985.fda78241bce1b808c191916b7b73a122. 2023-07-22 07:07:56,727 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 07:07:56,727 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690009675985.fda78241bce1b808c191916b7b73a122. started... 2023-07-22 07:07:56,729 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fda78241bce1b808c191916b7b73a122: 2023-07-22 07:07:56,730 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1690009675985.fda78241bce1b808c191916b7b73a122.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,730 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 07:07:56,730 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 07:07:56,749 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 07:07:56,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 07:07:56,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-22 07:07:56,750 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 07:07:56,754 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690009675985.fda78241bce1b808c191916b7b73a122. completed. 2023-07-22 07:07:56,754 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1690009675985.fda78241bce1b808c191916b7b73a122. 2023-07-22 07:07:56,754 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 07:07:56,754 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 07:07:56,754 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:56,754 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-22 07:07:56,754 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44269,1690009574260' in zk 2023-07-22 07:07:56,755 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690009675985.0821a58334f0aaf2cb810b908a398adb. completed. 2023-07-22 07:07:56,755 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1690009675985.0821a58334f0aaf2cb810b908a398adb. 2023-07-22 07:07:56,755 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 07:07:56,755 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 07:07:56,755 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:56,755 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-22 07:07:56,755 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43271,1690009574333' in zk 2023-07-22 07:07:56,756 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-22 07:07:56,756 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:07:56,756 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-22 07:07:56,756 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:56,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:56,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:07:56,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:07:56,759 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:56,759 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-22 07:07:56,759 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:07:56,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:07:56,759 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-22 07:07:56,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:07:56,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:56,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:56,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:56,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:07:56,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:56,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:56,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:56,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,44269,1690009574260': 2023-07-22 07:07:56,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44269,1690009574260' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-22 07:07:56,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:56,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:07:56,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:07:56,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:07:56,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:07:56,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:56,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:56,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:56,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:07:56,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:56,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:56,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:56,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,43271,1690009574333': 2023-07-22 07:07:56,776 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43271,1690009574333' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-22 07:07:56,776 INFO [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-22 07:07:56,776 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 07:07:56,776 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 07:07:56,776 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,776 INFO [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 07:07:56,778 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,778 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,778 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,778 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:07:56,778 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:07:56,778 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,778 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:07:56,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,778 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:56,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:07:56,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:07:56,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:07:56,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:07:56,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:07:56,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:07:56,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:07:56,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:07:56,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,779 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:56,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:07:56,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,780 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:56,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:07:56,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:56,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:56,782 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:56,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:56,782 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:56,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:07:56,782 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:56,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:56,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:56,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:56,787 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:56,787 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:07:56,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:07:56,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:07:56,787 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:07:56,787 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:07:56,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:07:56,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:07:56,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:07:56,787 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:07:56,788 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:56,787 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,787 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:07:56,787 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:07:56,787 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:07:56,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:07:56,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:07:56,788 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-22 07:07:56,788 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:56,790 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:07:56,789 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:07:56,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:07:56,790 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-22 07:07:56,790 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,790 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:56,790 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,790 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:56,790 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:56,790 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,790 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:07:56,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:07:56,791 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-22 07:07:56,805 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,806 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,842 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,866 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-22 07:07:56,867 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,867 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:56,867 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1690009676647Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1690009676805 (+158 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1690009676805Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1690009676805Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1690009676809 (+4 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1690009676836 (+27 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1690009676866 (+30 ms) 2023-07-22 07:07:56,871 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-22 07:07:56,873 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 224 msec 2023-07-22 07:07:56,951 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 07:07:56,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 07:07:56,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 07:07:56,954 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43271] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1690009675985.0821a58334f0aaf2cb810b908a398adb. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 07:07:56,955 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44269] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1690009675985.fda78241bce1b808c191916b7b73a122. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 07:07:56,958 DEBUG [Listener at jenkins-hbase4.apache.org/45401] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-22 07:07:56,958 DEBUG [Listener at jenkins-hbase4.apache.org/45401] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1690009675985.0821a58334f0aaf2cb810b908a398adb. 2023-07-22 07:07:56,958 INFO [Listener at jenkins-hbase4.apache.org/45401] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 07:07:56,967 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 07:07:56,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690009676967 (current time:1690009676967). 2023-07-22 07:07:56,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 07:07:56,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(139): Connect 0x6e5be985 to 127.0.0.1:63277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 07:07:56,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@749e478e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 07:07:56,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 07:07:56,976 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46238, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 07:07:56,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6e5be985 to 127.0.0.1:63277 2023-07-22 07:07:56,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 07:07:56,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(139): Connect 0x5d0be302 to 127.0.0.1:63277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 07:07:57,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6c2d3ee7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 07:07:57,002 DEBUG [hconnection-0x6a09a6db-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 07:07:57,005 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46248, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 07:07:57,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 07:07:57,009 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38446, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 07:07:57,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5d0be302 to 127.0.0.1:63277 2023-07-22 07:07:57,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 07:07:57,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-22 07:07:57,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 07:07:57,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 07:07:57,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-22 07:07:57,014 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-22 07:07:57,015 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690010277015 2023-07-22 07:07:57,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 07:07:57,015 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-22 07:07:57,017 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 07:07:57,017 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 07:07:57,018 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-22 07:07:57,018 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-22 07:07:57,019 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-22 07:07:57,020 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-22 07:07:57,021 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690010277021 2023-07-22 07:07:57,029 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,029 INFO [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-22 07:07:57,030 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:07:57,031 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-22 07:07:57,031 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-22 07:07:57,031 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,031 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,035 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:07:57,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:07:57,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:07:57,035 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:57,036 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:07:57,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:07:57,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:07:57,037 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:07:57,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:07:57,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:07:57,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,038 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:57,038 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:57,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,038 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:57,038 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 07:07:57,038 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,038 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-22 07:07:57,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,039 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-22 07:07:57,039 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-22 07:07:57,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,039 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-22 07:07:57,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-22 07:07:57,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,039 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-22 07:07:57,048 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,048 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-22 07:07:57,048 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:07:57,054 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-22 07:07:57,054 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-22 07:07:57,054 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34707,1690009574173' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-22 07:07:57,055 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,056 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,056 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 07:07:57,062 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,062 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,062 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-22 07:07:57,062 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:07:57,062 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-22 07:07:57,065 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:07:57,065 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-22 07:07:57,065 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-22 07:07:57,065 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44269,1690009574260' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-22 07:07:57,068 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-22 07:07:57,068 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-22 07:07:57,069 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43271,1690009574333' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-22 07:07:57,070 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:57,070 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:57,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:07:57,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:07:57,070 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,070 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 07:07:57,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:07:57,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:07:57,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:57,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:57,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:07:57,072 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43271,1690009574333' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-22 07:07:57,072 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c47bb0d[Count = 1] remaining members to acquire global barrier 2023-07-22 07:07:57,076 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,076 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:57,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:57,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:07:57,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:07:57,077 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,077 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 07:07:57,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:07:57,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:07:57,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:57,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:57,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:57,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:07:57,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44269,1690009574260' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-22 07:07:57,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c47bb0d[Count = 0] remaining members to acquire global barrier 2023-07-22 07:07:57,079 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-22 07:07:57,079 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,085 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,085 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,085 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,086 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-22 07:07:57,085 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-22 07:07:57,086 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-22 07:07:57,086 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:57,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,086 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-22 07:07:57,086 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34707,1690009574173' in zk 2023-07-22 07:07:57,086 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:57,086 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 07:07:57,087 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-22 07:07:57,087 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:07:57,087 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-22 07:07:57,091 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 07:07:57,091 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 07:07:57,093 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 07:07:57,093 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 07:07:57,093 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1690009675985.0821a58334f0aaf2cb810b908a398adb. 2023-07-22 07:07:57,093 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1690009675985.fda78241bce1b808c191916b7b73a122. 2023-07-22 07:07:57,093 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690009675985.0821a58334f0aaf2cb810b908a398adb. started... 2023-07-22 07:07:57,093 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690009675985.fda78241bce1b808c191916b7b73a122. started... 2023-07-22 07:07:57,093 INFO [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0821a58334f0aaf2cb810b908a398adb 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-22 07:07:57,094 INFO [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] regionserver.HRegion(2745): Flushing fda78241bce1b808c191916b7b73a122 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-22 07:07:57,114 INFO [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307227537b031a6c04d26acff97adb2318903 to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307227537b031a6c04d26acff97adb2318903 2023-07-22 07:07:57,117 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 07:07:57,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 07:07:57,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-22 07:07:57,118 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 07:07:57,134 INFO [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023072263e52d6a3496406c8f3855e012558a29 to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023072263e52d6a3496406c8f3855e012558a29 2023-07-22 07:07:57,143 INFO [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testEmptyExportFileSystemState/0821a58334f0aaf2cb810b908a398adb/.tmp/cf/4fb10ffa727d4e64ad8badbff56697b3 2023-07-22 07:07:57,146 INFO [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testEmptyExportFileSystemState/fda78241bce1b808c191916b7b73a122/.tmp/cf/d1a001cf1ab1432799c49ded03472f09 2023-07-22 07:07:57,149 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testEmptyExportFileSystemState/0821a58334f0aaf2cb810b908a398adb/.tmp/cf/4fb10ffa727d4e64ad8badbff56697b3 as hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testEmptyExportFileSystemState/0821a58334f0aaf2cb810b908a398adb/cf/4fb10ffa727d4e64ad8badbff56697b3 2023-07-22 07:07:57,151 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testEmptyExportFileSystemState/fda78241bce1b808c191916b7b73a122/.tmp/cf/d1a001cf1ab1432799c49ded03472f09 as hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testEmptyExportFileSystemState/fda78241bce1b808c191916b7b73a122/cf/d1a001cf1ab1432799c49ded03472f09 2023-07-22 07:07:57,155 INFO [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testEmptyExportFileSystemState/0821a58334f0aaf2cb810b908a398adb/cf/4fb10ffa727d4e64ad8badbff56697b3, entries=6, sequenceid=6, filesize=5.9 K 2023-07-22 07:07:57,156 INFO [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 0821a58334f0aaf2cb810b908a398adb in 62ms, sequenceid=6, compaction requested=false 2023-07-22 07:07:57,156 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-22 07:07:57,156 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0821a58334f0aaf2cb810b908a398adb: 2023-07-22 07:07:57,157 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1690009675985.0821a58334f0aaf2cb810b908a398adb.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,160 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 07:07:57,160 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testEmptyExportFileSystemState/0821a58334f0aaf2cb810b908a398adb/cf/4fb10ffa727d4e64ad8badbff56697b3] hfiles 2023-07-22 07:07:57,160 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testEmptyExportFileSystemState/0821a58334f0aaf2cb810b908a398adb/cf/4fb10ffa727d4e64ad8badbff56697b3 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,162 INFO [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testEmptyExportFileSystemState/fda78241bce1b808c191916b7b73a122/cf/d1a001cf1ab1432799c49ded03472f09, entries=44, sequenceid=6, filesize=12.6 K 2023-07-22 07:07:57,163 INFO [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for fda78241bce1b808c191916b7b73a122 in 70ms, sequenceid=6, compaction requested=false 2023-07-22 07:07:57,168 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fda78241bce1b808c191916b7b73a122: 2023-07-22 07:07:57,168 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1690009675985.fda78241bce1b808c191916b7b73a122.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,168 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 07:07:57,168 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testEmptyExportFileSystemState/fda78241bce1b808c191916b7b73a122/cf/d1a001cf1ab1432799c49ded03472f09] hfiles 2023-07-22 07:07:57,168 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testEmptyExportFileSystemState/fda78241bce1b808c191916b7b73a122/cf/d1a001cf1ab1432799c49ded03472f09 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,179 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690009675985.0821a58334f0aaf2cb810b908a398adb. completed. 2023-07-22 07:07:57,179 DEBUG [rs(jenkins-hbase4.apache.org,43271,1690009574333)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1690009675985.0821a58334f0aaf2cb810b908a398adb. 2023-07-22 07:07:57,179 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 07:07:57,179 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 07:07:57,179 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:57,179 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-22 07:07:57,179 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43271,1690009574333' in zk 2023-07-22 07:07:57,182 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:57,182 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-22 07:07:57,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:57,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:07:57,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:07:57,182 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:07:57,182 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-22 07:07:57,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:07:57,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:07:57,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:57,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:57,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:57,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:07:57,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,188 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690009675985.fda78241bce1b808c191916b7b73a122. completed. 2023-07-22 07:07:57,188 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1690009675985.fda78241bce1b808c191916b7b73a122. 2023-07-22 07:07:57,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:57,188 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 07:07:57,188 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 07:07:57,188 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:57,188 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-22 07:07:57,188 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44269,1690009574260' in zk 2023-07-22 07:07:57,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:57,189 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:57,189 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-22 07:07:57,189 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:07:57,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,43271,1690009574333': 2023-07-22 07:07:57,189 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-22 07:07:57,190 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43271,1690009574333' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-22 07:07:57,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:57,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:07:57,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:07:57,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:07:57,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:07:57,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:57,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:57,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:57,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:07:57,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:57,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:57,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:57,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,44269,1690009574260': 2023-07-22 07:07:57,193 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44269,1690009574260' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-22 07:07:57,193 INFO [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-22 07:07:57,194 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 07:07:57,194 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 07:07:57,194 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,194 INFO [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 07:07:57,195 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,195 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,195 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,195 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:07:57,195 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,195 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:07:57,196 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:57,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:07:57,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:07:57,195 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:07:57,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:07:57,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:07:57,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:07:57,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:07:57,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:07:57,196 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:57,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:07:57,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:07:57,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,197 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:57,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:07:57,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:57,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:57,198 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:57,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:57,199 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:57,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:07:57,199 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:57,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:57,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:57,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:57,202 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:57,202 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:07:57,202 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:07:57,202 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:07:57,202 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:57,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:07:57,202 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,202 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:57,202 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-22 07:07:57,202 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:07:57,202 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,202 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,203 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-22 07:07:57,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:07:57,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:07:57,203 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:07:57,204 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,204 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:07:57,204 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:07:57,204 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,204 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,204 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023072263e52d6a3496406c8f3855e012558a29, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307227537b031a6c04d26acff97adb2318903] mob files 2023-07-22 07:07:57,204 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023072263e52d6a3496406c8f3855e012558a29 2023-07-22 07:07:57,204 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307227537b031a6c04d26acff97adb2318903 2023-07-22 07:07:57,206 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:07:57,206 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:07:57,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:07:57,206 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:07:57,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:07:57,207 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:07:57,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:07:57,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:07:57,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:07:57,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:07:57,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:07:57,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:07:57,216 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,216 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,243 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,264 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-22 07:07:57,265 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,265 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,265 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1690009677015Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1690009677216 (+201 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1690009677216Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1690009677216Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1690009677221 (+5 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1690009677233 (+12 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1690009677264 (+31 ms) 2023-07-22 07:07:57,271 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-22 07:07:57,273 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 254 msec 2023-07-22 07:07:57,319 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 07:07:57,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 07:07:57,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 07:07:57,320 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009677320 2023-07-22 07:07:57,321 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45491, tgtDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009677320, rawTgtDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009677320, srcFsUri=hdfs://localhost:45491, srcDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03 2023-07-22 07:07:57,350 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45491, inputRoot=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03 2023-07-22 07:07:57,351 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-408787346_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009677320, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009677320/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,351 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45491, inputRoot=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03, snapshotDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-22 07:07:57,357 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009677320/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:07:57,397 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:57,397 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:57,398 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:57,398 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:57,399 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:57,399 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:57,400 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:57,484 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/hadoop-7553111215270453880.jar 2023-07-22 07:07:57,485 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:57,486 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:57,486 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:57,487 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:57,487 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:57,488 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-22 07:07:57,488 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-22 07:07:57,488 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-22 07:07:57,489 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-22 07:07:57,489 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-22 07:07:57,489 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-22 07:07:57,490 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-22 07:07:57,490 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-22 07:07:57,491 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-22 07:07:57,491 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-22 07:07:57,492 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-22 07:07:57,492 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 07:07:57,492 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 07:07:57,493 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 07:07:57,493 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 07:07:57,493 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 07:07:57,493 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 07:07:57,494 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 07:07:58,359 WARN [Listener at jenkins-hbase4.apache.org/45401] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-22 07:07:58,361 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-22 07:07:59,256 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 07:07:59,256 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 07:07:59,265 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690009582157_0005_000001 (auth:SIMPLE) 2023-07-22 07:07:59,737 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690009582157_0006_000001 (auth:SIMPLE) 2023-07-22 07:08:00,862 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 07:08:06,311 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690009582157_0006_000001 (auth:SIMPLE) 2023-07-22 07:08:08,916 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-22 07:08:08,924 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-22 07:08:08,943 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:08:08,943 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-22 07:08:08,945 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-22 07:08:08,945 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_663023864_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:08:08,946 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(367): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-22 07:08:08,946 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(367): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-22 07:08:08,946 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_663023864_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009677320/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009677320/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:08:08,947 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(367): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009677320/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-22 07:08:08,947 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(367): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009677320/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-22 07:08:08,953 INFO [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-22 07:08:08,953 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-22 07:08:08,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 07:08:08,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-22 07:08:08,961 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690009688960"}]},"ts":"1690009688960"} 2023-07-22 07:08:08,963 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-22 07:08:08,966 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-22 07:08:08,967 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0821a58334f0aaf2cb810b908a398adb, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fda78241bce1b808c191916b7b73a122, UNASSIGN}] 2023-07-22 07:08:08,968 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0821a58334f0aaf2cb810b908a398adb, UNASSIGN 2023-07-22 07:08:08,970 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fda78241bce1b808c191916b7b73a122, UNASSIGN 2023-07-22 07:08:08,971 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=0821a58334f0aaf2cb810b908a398adb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:08:08,971 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=fda78241bce1b808c191916b7b73a122, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:08:08,971 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1690009675985.0821a58334f0aaf2cb810b908a398adb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690009688971"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690009688971"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690009688971"}]},"ts":"1690009688971"} 2023-07-22 07:08:08,971 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1690009675985.fda78241bce1b808c191916b7b73a122.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690009688971"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690009688971"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690009688971"}]},"ts":"1690009688971"} 2023-07-22 07:08:08,973 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 0821a58334f0aaf2cb810b908a398adb, server=jenkins-hbase4.apache.org,43271,1690009574333}] 2023-07-22 07:08:08,974 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure fda78241bce1b808c191916b7b73a122, server=jenkins-hbase4.apache.org,44269,1690009574260}] 2023-07-22 07:08:09,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-22 07:08:09,125 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close fda78241bce1b808c191916b7b73a122 2023-07-22 07:08:09,125 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0821a58334f0aaf2cb810b908a398adb 2023-07-22 07:08:09,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fda78241bce1b808c191916b7b73a122, disabling compactions & flushes 2023-07-22 07:08:09,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0821a58334f0aaf2cb810b908a398adb, disabling compactions & flushes 2023-07-22 07:08:09,126 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1690009675985.fda78241bce1b808c191916b7b73a122. 2023-07-22 07:08:09,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1690009675985.fda78241bce1b808c191916b7b73a122. 2023-07-22 07:08:09,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1690009675985.fda78241bce1b808c191916b7b73a122. after waiting 0 ms 2023-07-22 07:08:09,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1690009675985.fda78241bce1b808c191916b7b73a122. 2023-07-22 07:08:09,126 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1690009675985.0821a58334f0aaf2cb810b908a398adb. 2023-07-22 07:08:09,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1690009675985.0821a58334f0aaf2cb810b908a398adb. 2023-07-22 07:08:09,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1690009675985.0821a58334f0aaf2cb810b908a398adb. after waiting 0 ms 2023-07-22 07:08:09,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1690009675985.0821a58334f0aaf2cb810b908a398adb. 2023-07-22 07:08:09,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testEmptyExportFileSystemState/0821a58334f0aaf2cb810b908a398adb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 07:08:09,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testEmptyExportFileSystemState/fda78241bce1b808c191916b7b73a122/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 07:08:09,146 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 07:08:09,146 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 07:08:09,147 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1690009675985.0821a58334f0aaf2cb810b908a398adb. 2023-07-22 07:08:09,148 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1690009675985.fda78241bce1b808c191916b7b73a122. 2023-07-22 07:08:09,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0821a58334f0aaf2cb810b908a398adb: 2023-07-22 07:08:09,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fda78241bce1b808c191916b7b73a122: 2023-07-22 07:08:09,149 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0821a58334f0aaf2cb810b908a398adb 2023-07-22 07:08:09,150 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=0821a58334f0aaf2cb810b908a398adb, regionState=CLOSED 2023-07-22 07:08:09,150 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed fda78241bce1b808c191916b7b73a122 2023-07-22 07:08:09,150 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1690009675985.0821a58334f0aaf2cb810b908a398adb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690009689150"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690009689150"}]},"ts":"1690009689150"} 2023-07-22 07:08:09,151 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=fda78241bce1b808c191916b7b73a122, regionState=CLOSED 2023-07-22 07:08:09,151 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1690009675985.fda78241bce1b808c191916b7b73a122.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690009689151"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690009689151"}]},"ts":"1690009689151"} 2023-07-22 07:08:09,155 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-22 07:08:09,155 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 0821a58334f0aaf2cb810b908a398adb, server=jenkins-hbase4.apache.org,43271,1690009574333 in 179 msec 2023-07-22 07:08:09,155 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-22 07:08:09,156 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure fda78241bce1b808c191916b7b73a122, server=jenkins-hbase4.apache.org,44269,1690009574260 in 179 msec 2023-07-22 07:08:09,156 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0821a58334f0aaf2cb810b908a398adb, UNASSIGN in 188 msec 2023-07-22 07:08:09,157 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-22 07:08:09,157 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fda78241bce1b808c191916b7b73a122, UNASSIGN in 189 msec 2023-07-22 07:08:09,158 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690009689157"}]},"ts":"1690009689157"} 2023-07-22 07:08:09,159 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-22 07:08:09,161 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-22 07:08:09,164 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 209 msec 2023-07-22 07:08:09,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-22 07:08:09,263 INFO [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-22 07:08:09,263 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-22 07:08:09,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 07:08:09,266 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 07:08:09,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-22 07:08:09,267 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 07:08:09,268 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44269] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-22 07:08:09,271 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 07:08:09,271 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 07:08:09,271 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 07:08:09,271 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 07:08:09,272 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-22 07:08:09,272 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-22 07:08:09,272 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-22 07:08:09,272 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-22 07:08:09,277 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testEmptyExportFileSystemState/fda78241bce1b808c191916b7b73a122 2023-07-22 07:08:09,277 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testEmptyExportFileSystemState/0821a58334f0aaf2cb810b908a398adb 2023-07-22 07:08:09,278 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 07:08:09,278 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 07:08:09,278 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 07:08:09,278 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 07:08:09,278 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:08:09,278 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:08:09,278 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:08:09,278 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:08:09,279 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testEmptyExportFileSystemState/fda78241bce1b808c191916b7b73a122/cf, FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testEmptyExportFileSystemState/fda78241bce1b808c191916b7b73a122/recovered.edits] 2023-07-22 07:08:09,279 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testEmptyExportFileSystemState/0821a58334f0aaf2cb810b908a398adb/cf, FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testEmptyExportFileSystemState/0821a58334f0aaf2cb810b908a398adb/recovered.edits] 2023-07-22 07:08:09,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-22 07:08:09,284 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testEmptyExportFileSystemState/fda78241bce1b808c191916b7b73a122/cf/d1a001cf1ab1432799c49ded03472f09 to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/archive/data/default/testtb-testEmptyExportFileSystemState/fda78241bce1b808c191916b7b73a122/cf/d1a001cf1ab1432799c49ded03472f09 2023-07-22 07:08:09,284 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testEmptyExportFileSystemState/0821a58334f0aaf2cb810b908a398adb/cf/4fb10ffa727d4e64ad8badbff56697b3 to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/archive/data/default/testtb-testEmptyExportFileSystemState/0821a58334f0aaf2cb810b908a398adb/cf/4fb10ffa727d4e64ad8badbff56697b3 2023-07-22 07:08:09,287 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testEmptyExportFileSystemState/fda78241bce1b808c191916b7b73a122/recovered.edits/9.seqid to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/archive/data/default/testtb-testEmptyExportFileSystemState/fda78241bce1b808c191916b7b73a122/recovered.edits/9.seqid 2023-07-22 07:08:09,287 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testEmptyExportFileSystemState/0821a58334f0aaf2cb810b908a398adb/recovered.edits/9.seqid to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/archive/data/default/testtb-testEmptyExportFileSystemState/0821a58334f0aaf2cb810b908a398adb/recovered.edits/9.seqid 2023-07-22 07:08:09,288 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testEmptyExportFileSystemState/fda78241bce1b808c191916b7b73a122 2023-07-22 07:08:09,288 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testEmptyExportFileSystemState/0821a58334f0aaf2cb810b908a398adb 2023-07-22 07:08:09,288 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-22 07:08:09,288 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-22 07:08:09,289 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-22 07:08:09,293 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023072263e52d6a3496406c8f3855e012558a29 to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023072263e52d6a3496406c8f3855e012558a29 2023-07-22 07:08:09,295 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307227537b031a6c04d26acff97adb2318903 to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307227537b031a6c04d26acff97adb2318903 2023-07-22 07:08:09,295 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-22 07:08:09,298 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 07:08:09,301 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-22 07:08:09,303 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-22 07:08:09,305 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 07:08:09,305 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-22 07:08:09,305 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1690009675985.0821a58334f0aaf2cb810b908a398adb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690009689305"}]},"ts":"9223372036854775807"} 2023-07-22 07:08:09,305 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1690009675985.fda78241bce1b808c191916b7b73a122.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690009689305"}]},"ts":"9223372036854775807"} 2023-07-22 07:08:09,307 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-22 07:08:09,307 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0821a58334f0aaf2cb810b908a398adb, NAME => 'testtb-testEmptyExportFileSystemState,,1690009675985.0821a58334f0aaf2cb810b908a398adb.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => fda78241bce1b808c191916b7b73a122, NAME => 'testtb-testEmptyExportFileSystemState,1,1690009675985.fda78241bce1b808c191916b7b73a122.', STARTKEY => '1', ENDKEY => ''}] 2023-07-22 07:08:09,307 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-22 07:08:09,307 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690009689307"}]},"ts":"9223372036854775807"} 2023-07-22 07:08:09,309 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-22 07:08:09,310 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 07:08:09,312 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 47 msec 2023-07-22 07:08:09,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-22 07:08:09,380 INFO [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-22 07:08:09,388 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-22 07:08:09,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 07:08:09,391 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-22 07:08:09,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-22 07:08:09,418 INFO [Listener at jenkins-hbase4.apache.org/45401] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=760 (was 757) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6ff205ea-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1203180535) connection to jenkins-hbase4.apache.org/172.31.14.131:44147 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_663023864_17 at /127.0.0.1:38850 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4790 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1203180535) connection to jenkins-hbase4.apache.org/172.31.14.131:44861 from appattempt_1690009582157_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_663023864_17 at /127.0.0.1:45842 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_663023864_17 at /127.0.0.1:40976 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6ff205ea-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6ff205ea-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-563358470_1 at /127.0.0.1:45808 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1203180535) connection to jenkins-hbase4.apache.org/172.31.14.131:45401 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x6ff205ea-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=910 (was 905) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=562 (was 437) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 181), AvailableMemoryMB=5397 (was 5990) 2023-07-22 07:08:09,418 WARN [Listener at jenkins-hbase4.apache.org/45401] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-22 07:08:09,439 INFO [Listener at jenkins-hbase4.apache.org/45401] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=760, OpenFileDescriptor=910, MaxFileDescriptor=60000, SystemLoadAverage=562, ProcessCount=180, AvailableMemoryMB=5396 2023-07-22 07:08:09,439 WARN [Listener at jenkins-hbase4.apache.org/45401] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-22 07:08:09,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-22 07:08:09,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:09,444 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 07:08:09,444 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-22 07:08:09,445 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 07:08:09,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-22 07:08:09,447 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/1c83a1e9c42a66e88599bd591efaa978 2023-07-22 07:08:09,447 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/44342533261246d42cf6dd5082b72060 2023-07-22 07:08:09,448 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/1c83a1e9c42a66e88599bd591efaa978 empty. 2023-07-22 07:08:09,448 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/44342533261246d42cf6dd5082b72060 empty. 2023-07-22 07:08:09,448 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/1c83a1e9c42a66e88599bd591efaa978 2023-07-22 07:08:09,448 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/44342533261246d42cf6dd5082b72060 2023-07-22 07:08:09,448 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-22 07:08:09,462 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-22 07:08:09,463 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1c83a1e9c42a66e88599bd591efaa978, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690009689440.1c83a1e9c42a66e88599bd591efaa978.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp 2023-07-22 07:08:09,463 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 44342533261246d42cf6dd5082b72060, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690009689440.44342533261246d42cf6dd5082b72060.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp 2023-07-22 07:08:09,473 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1690009689440.1c83a1e9c42a66e88599bd591efaa978.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 07:08:09,473 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 1c83a1e9c42a66e88599bd591efaa978, disabling compactions & flushes 2023-07-22 07:08:09,473 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1690009689440.1c83a1e9c42a66e88599bd591efaa978. 2023-07-22 07:08:09,473 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690009689440.1c83a1e9c42a66e88599bd591efaa978. 2023-07-22 07:08:09,473 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690009689440.1c83a1e9c42a66e88599bd591efaa978. after waiting 0 ms 2023-07-22 07:08:09,473 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1690009689440.1c83a1e9c42a66e88599bd591efaa978. 2023-07-22 07:08:09,473 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1690009689440.1c83a1e9c42a66e88599bd591efaa978. 2023-07-22 07:08:09,473 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 1c83a1e9c42a66e88599bd591efaa978: 2023-07-22 07:08:09,475 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1690009689440.44342533261246d42cf6dd5082b72060.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 07:08:09,475 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 44342533261246d42cf6dd5082b72060, disabling compactions & flushes 2023-07-22 07:08:09,475 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1690009689440.44342533261246d42cf6dd5082b72060. 2023-07-22 07:08:09,475 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690009689440.44342533261246d42cf6dd5082b72060. 2023-07-22 07:08:09,476 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690009689440.44342533261246d42cf6dd5082b72060. after waiting 0 ms 2023-07-22 07:08:09,476 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1690009689440.44342533261246d42cf6dd5082b72060. 2023-07-22 07:08:09,476 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1690009689440.44342533261246d42cf6dd5082b72060. 2023-07-22 07:08:09,476 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 44342533261246d42cf6dd5082b72060: 2023-07-22 07:08:09,478 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 07:08:09,479 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690009689440.1c83a1e9c42a66e88599bd591efaa978.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690009689479"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690009689479"}]},"ts":"1690009689479"} 2023-07-22 07:08:09,479 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690009689440.44342533261246d42cf6dd5082b72060.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690009689479"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690009689479"}]},"ts":"1690009689479"} 2023-07-22 07:08:09,482 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-22 07:08:09,483 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 07:08:09,483 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690009689483"}]},"ts":"1690009689483"} 2023-07-22 07:08:09,487 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-22 07:08:09,501 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 07:08:09,504 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 07:08:09,504 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 07:08:09,504 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 07:08:09,504 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 07:08:09,504 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=1c83a1e9c42a66e88599bd591efaa978, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=44342533261246d42cf6dd5082b72060, ASSIGN}] 2023-07-22 07:08:09,507 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=44342533261246d42cf6dd5082b72060, ASSIGN 2023-07-22 07:08:09,507 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=1c83a1e9c42a66e88599bd591efaa978, ASSIGN 2023-07-22 07:08:09,508 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=1c83a1e9c42a66e88599bd591efaa978, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44269,1690009574260; forceNewPlan=false, retain=false 2023-07-22 07:08:09,508 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=44342533261246d42cf6dd5082b72060, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34707,1690009574173; forceNewPlan=false, retain=false 2023-07-22 07:08:09,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-22 07:08:09,659 INFO [jenkins-hbase4:44609] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-22 07:08:09,661 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=1c83a1e9c42a66e88599bd591efaa978, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:08:09,662 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=44342533261246d42cf6dd5082b72060, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:08:09,662 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690009689440.1c83a1e9c42a66e88599bd591efaa978.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690009689661"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690009689661"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690009689661"}]},"ts":"1690009689661"} 2023-07-22 07:08:09,662 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690009689440.44342533261246d42cf6dd5082b72060.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690009689661"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690009689661"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690009689661"}]},"ts":"1690009689661"} 2023-07-22 07:08:09,664 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 1c83a1e9c42a66e88599bd591efaa978, server=jenkins-hbase4.apache.org,44269,1690009574260}] 2023-07-22 07:08:09,665 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 44342533261246d42cf6dd5082b72060, server=jenkins-hbase4.apache.org,34707,1690009574173}] 2023-07-22 07:08:09,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-22 07:08:09,822 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1690009689440.1c83a1e9c42a66e88599bd591efaa978. 2023-07-22 07:08:09,822 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1690009689440.44342533261246d42cf6dd5082b72060. 2023-07-22 07:08:09,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 44342533261246d42cf6dd5082b72060, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690009689440.44342533261246d42cf6dd5082b72060.', STARTKEY => '1', ENDKEY => ''} 2023-07-22 07:08:09,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1c83a1e9c42a66e88599bd591efaa978, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690009689440.1c83a1e9c42a66e88599bd591efaa978.', STARTKEY => '', ENDKEY => '1'} 2023-07-22 07:08:09,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1690009689440.1c83a1e9c42a66e88599bd591efaa978. service=AccessControlService 2023-07-22 07:08:09,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1690009689440.44342533261246d42cf6dd5082b72060. service=AccessControlService 2023-07-22 07:08:09,822 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 07:08:09,822 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 07:08:09,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 1c83a1e9c42a66e88599bd591efaa978 2023-07-22 07:08:09,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 44342533261246d42cf6dd5082b72060 2023-07-22 07:08:09,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1690009689440.1c83a1e9c42a66e88599bd591efaa978.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 07:08:09,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1690009689440.44342533261246d42cf6dd5082b72060.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 07:08:09,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1c83a1e9c42a66e88599bd591efaa978 2023-07-22 07:08:09,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 44342533261246d42cf6dd5082b72060 2023-07-22 07:08:09,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1c83a1e9c42a66e88599bd591efaa978 2023-07-22 07:08:09,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 44342533261246d42cf6dd5082b72060 2023-07-22 07:08:09,824 INFO [StoreOpener-1c83a1e9c42a66e88599bd591efaa978-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1c83a1e9c42a66e88599bd591efaa978 2023-07-22 07:08:09,824 INFO [StoreOpener-44342533261246d42cf6dd5082b72060-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 44342533261246d42cf6dd5082b72060 2023-07-22 07:08:09,826 DEBUG [StoreOpener-44342533261246d42cf6dd5082b72060-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithSkipTmp/44342533261246d42cf6dd5082b72060/cf 2023-07-22 07:08:09,826 DEBUG [StoreOpener-44342533261246d42cf6dd5082b72060-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithSkipTmp/44342533261246d42cf6dd5082b72060/cf 2023-07-22 07:08:09,826 DEBUG [StoreOpener-1c83a1e9c42a66e88599bd591efaa978-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithSkipTmp/1c83a1e9c42a66e88599bd591efaa978/cf 2023-07-22 07:08:09,826 DEBUG [StoreOpener-1c83a1e9c42a66e88599bd591efaa978-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithSkipTmp/1c83a1e9c42a66e88599bd591efaa978/cf 2023-07-22 07:08:09,826 INFO [StoreOpener-44342533261246d42cf6dd5082b72060-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 44342533261246d42cf6dd5082b72060 columnFamilyName cf 2023-07-22 07:08:09,827 INFO [StoreOpener-1c83a1e9c42a66e88599bd591efaa978-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1c83a1e9c42a66e88599bd591efaa978 columnFamilyName cf 2023-07-22 07:08:09,828 INFO [StoreOpener-44342533261246d42cf6dd5082b72060-1] regionserver.HStore(310): Store=44342533261246d42cf6dd5082b72060/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 07:08:09,828 INFO [StoreOpener-1c83a1e9c42a66e88599bd591efaa978-1] regionserver.HStore(310): Store=1c83a1e9c42a66e88599bd591efaa978/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 07:08:09,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithSkipTmp/1c83a1e9c42a66e88599bd591efaa978 2023-07-22 07:08:09,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithSkipTmp/44342533261246d42cf6dd5082b72060 2023-07-22 07:08:09,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithSkipTmp/1c83a1e9c42a66e88599bd591efaa978 2023-07-22 07:08:09,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithSkipTmp/44342533261246d42cf6dd5082b72060 2023-07-22 07:08:09,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1c83a1e9c42a66e88599bd591efaa978 2023-07-22 07:08:09,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 44342533261246d42cf6dd5082b72060 2023-07-22 07:08:09,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithSkipTmp/1c83a1e9c42a66e88599bd591efaa978/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 07:08:09,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithSkipTmp/44342533261246d42cf6dd5082b72060/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 07:08:09,835 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1c83a1e9c42a66e88599bd591efaa978; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72185846, jitterRate=0.07565292716026306}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 07:08:09,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1c83a1e9c42a66e88599bd591efaa978: 2023-07-22 07:08:09,835 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 44342533261246d42cf6dd5082b72060; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64261689, jitterRate=-0.0424262136220932}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 07:08:09,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 44342533261246d42cf6dd5082b72060: 2023-07-22 07:08:09,836 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1690009689440.1c83a1e9c42a66e88599bd591efaa978., pid=108, masterSystemTime=1690009689816 2023-07-22 07:08:09,836 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1690009689440.44342533261246d42cf6dd5082b72060., pid=109, masterSystemTime=1690009689816 2023-07-22 07:08:09,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1690009689440.1c83a1e9c42a66e88599bd591efaa978. 2023-07-22 07:08:09,838 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1690009689440.1c83a1e9c42a66e88599bd591efaa978. 2023-07-22 07:08:09,838 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=1c83a1e9c42a66e88599bd591efaa978, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:08:09,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1690009689440.44342533261246d42cf6dd5082b72060. 2023-07-22 07:08:09,838 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1690009689440.44342533261246d42cf6dd5082b72060. 2023-07-22 07:08:09,838 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690009689440.1c83a1e9c42a66e88599bd591efaa978.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690009689838"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690009689838"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690009689838"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690009689838"}]},"ts":"1690009689838"} 2023-07-22 07:08:09,840 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=44342533261246d42cf6dd5082b72060, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:08:09,840 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690009689440.44342533261246d42cf6dd5082b72060.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690009689840"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690009689840"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690009689840"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690009689840"}]},"ts":"1690009689840"} 2023-07-22 07:08:09,842 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-22 07:08:09,843 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 1c83a1e9c42a66e88599bd591efaa978, server=jenkins-hbase4.apache.org,44269,1690009574260 in 177 msec 2023-07-22 07:08:09,843 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-22 07:08:09,843 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 44342533261246d42cf6dd5082b72060, server=jenkins-hbase4.apache.org,34707,1690009574173 in 177 msec 2023-07-22 07:08:09,844 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=1c83a1e9c42a66e88599bd591efaa978, ASSIGN in 339 msec 2023-07-22 07:08:09,845 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-22 07:08:09,845 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=44342533261246d42cf6dd5082b72060, ASSIGN in 339 msec 2023-07-22 07:08:09,846 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 07:08:09,846 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690009689846"}]},"ts":"1690009689846"} 2023-07-22 07:08:09,847 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-22 07:08:09,849 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 07:08:09,849 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-22 07:08:09,851 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44269] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-22 07:08:09,852 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:08:09,852 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:08:09,852 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:08:09,853 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:08:09,855 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-22 07:08:09,855 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-22 07:08:09,856 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-22 07:08:09,856 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-22 07:08:09,857 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 415 msec 2023-07-22 07:08:10,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-22 07:08:10,054 INFO [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-22 07:08:10,056 DEBUG [Listener at jenkins-hbase4.apache.org/45401] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,057 DEBUG [Listener at jenkins-hbase4.apache.org/45401] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1690009689440.1c83a1e9c42a66e88599bd591efaa978. 2023-07-22 07:08:10,058 INFO [Listener at jenkins-hbase4.apache.org/45401] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 07:08:10,069 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-22 07:08:10,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690009690069 (current time:1690009690069). 2023-07-22 07:08:10,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 07:08:10,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(139): Connect 0x33c16ef3 to 127.0.0.1:63277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 07:08:10,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7cf10a38, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 07:08:10,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 07:08:10,083 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51012, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 07:08:10,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33c16ef3 to 127.0.0.1:63277 2023-07-22 07:08:10,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 07:08:10,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(139): Connect 0x3b274fc8 to 127.0.0.1:63277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 07:08:10,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a918a9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 07:08:10,092 DEBUG [hconnection-0x777d622e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 07:08:10,098 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51024, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 07:08:10,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 07:08:10,106 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37352, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 07:08:10,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3b274fc8 to 127.0.0.1:63277 2023-07-22 07:08:10,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 07:08:10,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-22 07:08:10,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 07:08:10,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-22 07:08:10,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-22 07:08:10,114 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-22 07:08:10,123 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1690010290123 2023-07-22 07:08:10,123 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-22 07:08:10,125 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 07:08:10,125 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 07:08:10,127 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-22 07:08:10,127 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-22 07:08:10,128 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 16 msec 2023-07-22 07:08:10,130 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-22 07:08:10,130 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1690010290130 2023-07-22 07:08:10,164 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,164 INFO [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-22 07:08:10,164 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:08:10,166 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-22 07:08:10,166 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-22 07:08:10,212 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,212 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,213 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:08:10,213 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:08:10,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:08:10,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:08:10,213 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:08:10,213 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:08:10,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:08:10,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:08:10,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:08:10,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:08:10,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,214 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:08:10,214 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:08:10,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,214 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,214 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:08:10,214 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,214 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,214 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 07:08:10,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-22 07:08:10,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-22 07:08:10,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,215 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-22 07:08:10,215 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-22 07:08:10,215 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-22 07:08:10,215 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-22 07:08:10,215 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:08:10,215 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,216 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-22 07:08:10,217 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-22 07:08:10,216 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-22 07:08:10,217 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-22 07:08:10,217 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:08:10,217 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44269,1690009574260' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-22 07:08:10,217 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-22 07:08:10,218 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-22 07:08:10,218 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34707,1690009574173' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-22 07:08:10,218 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,218 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-22 07:08:10,218 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:08:10,219 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-22 07:08:10,219 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-22 07:08:10,219 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43271,1690009574333' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-22 07:08:10,225 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 07:08:10,226 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:08:10,226 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:08:10,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:08:10,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:08:10,226 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:08:10,226 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-22 07:08:10,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-22 07:08:10,226 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 07:08:10,228 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:08:10,228 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,228 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 07:08:10,228 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,228 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 07:08:10,228 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,228 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 07:08:10,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:08:10,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:08:10,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:08:10,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:08:10,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:08:10,229 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34707,1690009574173' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-22 07:08:10,229 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ba321bd[Count = 1] remaining members to acquire global barrier 2023-07-22 07:08:10,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:08:10,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:08:10,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:08:10,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:08:10,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:08:10,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:08:10,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:08:10,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:08:10,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:08:10,231 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44269,1690009574260' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-22 07:08:10,231 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ba321bd[Count = 0] remaining members to acquire global barrier 2023-07-22 07:08:10,231 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-22 07:08:10,231 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,233 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,233 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,233 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,233 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-22 07:08:10,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,233 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:08:10,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,233 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 07:08:10,233 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690009689440.44342533261246d42cf6dd5082b72060. 2023-07-22 07:08:10,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,233 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690009689440.44342533261246d42cf6dd5082b72060. started... 2023-07-22 07:08:10,233 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 07:08:10,233 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-22 07:08:10,233 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:08:10,233 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 07:08:10,233 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-22 07:08:10,235 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 44342533261246d42cf6dd5082b72060: 2023-07-22 07:08:10,235 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690009689440.1c83a1e9c42a66e88599bd591efaa978. 2023-07-22 07:08:10,235 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-22 07:08:10,235 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43271,1690009574333' in zk 2023-07-22 07:08:10,235 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 07:08:10,235 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 07:08:10,235 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1690009689440.44342533261246d42cf6dd5082b72060.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,235 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690009689440.1c83a1e9c42a66e88599bd591efaa978. started... 2023-07-22 07:08:10,235 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 07:08:10,235 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 07:08:10,235 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1c83a1e9c42a66e88599bd591efaa978: 2023-07-22 07:08:10,236 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1690009689440.1c83a1e9c42a66e88599bd591efaa978.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,236 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 07:08:10,236 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 07:08:10,236 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-22 07:08:10,236 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:08:10,236 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-22 07:08:10,250 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690009689440.1c83a1e9c42a66e88599bd591efaa978. completed. 2023-07-22 07:08:10,251 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690009689440.1c83a1e9c42a66e88599bd591efaa978. 2023-07-22 07:08:10,251 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 07:08:10,251 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 07:08:10,251 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:08:10,251 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-22 07:08:10,251 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44269,1690009574260' in zk 2023-07-22 07:08:10,253 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-22 07:08:10,253 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:08:10,253 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:08:10,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:08:10,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:08:10,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:08:10,253 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-22 07:08:10,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:08:10,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:08:10,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:08:10,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:08:10,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:08:10,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:08:10,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:08:10,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:08:10,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,44269,1690009574260': 2023-07-22 07:08:10,258 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44269,1690009574260' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-22 07:08:10,259 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690009689440.44342533261246d42cf6dd5082b72060. completed. 2023-07-22 07:08:10,259 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690009689440.44342533261246d42cf6dd5082b72060. 2023-07-22 07:08:10,259 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 07:08:10,259 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 07:08:10,259 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:08:10,259 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-22 07:08:10,259 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34707,1690009574173' in zk 2023-07-22 07:08:10,262 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-22 07:08:10,262 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:08:10,262 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:08:10,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:08:10,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:08:10,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:08:10,262 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-22 07:08:10,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:08:10,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:08:10,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:08:10,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:08:10,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:08:10,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:08:10,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:08:10,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:08:10,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:08:10,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,34707,1690009574173': 2023-07-22 07:08:10,267 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34707,1690009574173' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-22 07:08:10,267 INFO [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-22 07:08:10,267 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 07:08:10,267 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 07:08:10,267 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,268 INFO [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 07:08:10,269 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,269 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:08:10,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,269 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,269 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:08:10,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:08:10,269 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,269 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:08:10,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,270 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:08:10,270 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:08:10,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:08:10,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:08:10,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:08:10,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:08:10,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:08:10,270 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:08:10,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:08:10,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:08:10,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,271 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:08:10,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:08:10,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:08:10,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:08:10,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:08:10,273 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:08:10,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:08:10,273 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:08:10,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,273 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:08:10,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:08:10,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:08:10,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:08:10,276 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:08:10,276 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:08:10,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:08:10,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:08:10,276 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,277 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:08:10,277 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:08:10,277 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,277 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:08:10,277 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,277 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:08:10,277 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:08:10,277 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,277 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,276 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:08:10,276 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:08:10,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:08:10,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:08:10,276 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:08:10,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:08:10,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:08:10,277 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:08:10,277 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,277 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:08:10,277 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:08:10,279 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,277 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:08:10,279 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-22 07:08:10,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:08:10,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:08:10,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:08:10,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:08:10,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:08:10,280 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-22 07:08:10,290 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,291 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,317 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,340 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-22 07:08:10,341 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,341 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,341 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1690009690123Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1690009690290 (+167 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690009690290Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690009690291 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690009690294 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690009690312 (+18 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1690009690340 (+28 ms) 2023-07-22 07:08:10,344 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-22 07:08:10,345 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 219 msec 2023-07-22 07:08:10,426 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 07:08:10,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-22 07:08:10,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 07:08:10,430 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44269] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1690009689440.1c83a1e9c42a66e88599bd591efaa978. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 07:08:10,431 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34707] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1690009689440.44342533261246d42cf6dd5082b72060. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 07:08:10,435 DEBUG [Listener at jenkins-hbase4.apache.org/45401] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,435 DEBUG [Listener at jenkins-hbase4.apache.org/45401] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1690009689440.1c83a1e9c42a66e88599bd591efaa978. 2023-07-22 07:08:10,435 INFO [Listener at jenkins-hbase4.apache.org/45401] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 07:08:10,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-22 07:08:10,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690009690446 (current time:1690009690446). 2023-07-22 07:08:10,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 07:08:10,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(139): Connect 0x3f2bd0da to 127.0.0.1:63277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 07:08:10,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@235bb903, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 07:08:10,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 07:08:10,458 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52556, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 07:08:10,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f2bd0da to 127.0.0.1:63277 2023-07-22 07:08:10,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 07:08:10,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(139): Connect 0x60830844 to 127.0.0.1:63277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 07:08:10,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1cfb98e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 07:08:10,469 DEBUG [hconnection-0x7f228b15-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 07:08:10,470 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52560, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 07:08:10,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 07:08:10,477 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38672, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 07:08:10,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x60830844 to 127.0.0.1:63277 2023-07-22 07:08:10,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 07:08:10,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-22 07:08:10,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 07:08:10,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-22 07:08:10,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-22 07:08:10,483 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-22 07:08:10,483 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1690010290483 2023-07-22 07:08:10,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-22 07:08:10,483 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,485 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 07:08:10,485 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 07:08:10,486 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-22 07:08:10,486 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-22 07:08:10,487 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-07-22 07:08:10,488 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-22 07:08:10,489 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1690010290489 2023-07-22 07:08:10,505 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,505 INFO [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-22 07:08:10,505 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:08:10,507 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-22 07:08:10,507 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-22 07:08:10,507 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,507 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,509 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:08:10,509 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:08:10,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:08:10,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:08:10,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:08:10,509 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:08:10,509 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:08:10,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:08:10,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:08:10,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:08:10,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,509 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:08:10,509 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:08:10,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,510 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,510 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:08:10,510 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-22 07:08:10,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,510 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 07:08:10,510 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,511 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-22 07:08:10,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-22 07:08:10,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,511 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-22 07:08:10,511 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-22 07:08:10,511 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:08:10,511 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-22 07:08:10,512 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-22 07:08:10,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,512 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-22 07:08:10,512 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43271,1690009574333' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-22 07:08:10,513 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-22 07:08:10,513 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,513 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,513 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-22 07:08:10,513 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-22 07:08:10,513 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:08:10,513 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 07:08:10,514 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-22 07:08:10,515 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-22 07:08:10,515 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-22 07:08:10,515 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-22 07:08:10,515 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34707,1690009574173' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-22 07:08:10,515 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44269,1690009574260' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-22 07:08:10,517 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,518 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,518 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:08:10,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:08:10,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:08:10,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:08:10,519 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:08:10,519 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:08:10,519 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,519 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 07:08:10,519 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,519 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 07:08:10,519 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,519 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 07:08:10,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:08:10,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:08:10,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:08:10,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:08:10,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:08:10,521 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34707,1690009574173' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-22 07:08:10,521 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@69f481dd[Count = 1] remaining members to acquire global barrier 2023-07-22 07:08:10,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:08:10,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:08:10,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:08:10,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:08:10,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:08:10,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:08:10,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:08:10,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:08:10,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:08:10,524 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44269,1690009574260' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-22 07:08:10,524 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@69f481dd[Count = 0] remaining members to acquire global barrier 2023-07-22 07:08:10,524 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-22 07:08:10,524 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,529 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,529 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,529 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,530 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-22 07:08:10,530 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:08:10,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,530 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-22 07:08:10,530 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-22 07:08:10,530 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43271,1690009574333' in zk 2023-07-22 07:08:10,530 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:08:10,530 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 07:08:10,530 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 07:08:10,530 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 07:08:10,530 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-22 07:08:10,531 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 07:08:10,531 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 07:08:10,531 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690009689440.44342533261246d42cf6dd5082b72060. 2023-07-22 07:08:10,531 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690009689440.44342533261246d42cf6dd5082b72060. started... 2023-07-22 07:08:10,531 INFO [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 44342533261246d42cf6dd5082b72060 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-22 07:08:10,531 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690009689440.1c83a1e9c42a66e88599bd591efaa978. 2023-07-22 07:08:10,531 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690009689440.1c83a1e9c42a66e88599bd591efaa978. started... 2023-07-22 07:08:10,531 INFO [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1c83a1e9c42a66e88599bd591efaa978 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-22 07:08:10,531 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-22 07:08:10,531 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:08:10,531 DEBUG [member: 'jenkins-hbase4.apache.org,43271,1690009574333' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-22 07:08:10,570 INFO [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023072200126dd0b87146e0a4dcf16d620f450a to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023072200126dd0b87146e0a4dcf16d620f450a 2023-07-22 07:08:10,574 INFO [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307222efcc1c8e0b74aa4857044e5eb37f7da to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307222efcc1c8e0b74aa4857044e5eb37f7da 2023-07-22 07:08:10,585 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 07:08:10,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-22 07:08:10,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-22 07:08:10,587 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 07:08:10,589 INFO [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithSkipTmp/44342533261246d42cf6dd5082b72060/.tmp/cf/da4d8f2249f649ff9eb260aee1f740cd 2023-07-22 07:08:10,593 INFO [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithSkipTmp/1c83a1e9c42a66e88599bd591efaa978/.tmp/cf/d5a1c81c34224fabad172ff9a6eacfb0 2023-07-22 07:08:10,596 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithSkipTmp/44342533261246d42cf6dd5082b72060/.tmp/cf/da4d8f2249f649ff9eb260aee1f740cd as hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithSkipTmp/44342533261246d42cf6dd5082b72060/cf/da4d8f2249f649ff9eb260aee1f740cd 2023-07-22 07:08:10,598 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithSkipTmp/1c83a1e9c42a66e88599bd591efaa978/.tmp/cf/d5a1c81c34224fabad172ff9a6eacfb0 as hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithSkipTmp/1c83a1e9c42a66e88599bd591efaa978/cf/d5a1c81c34224fabad172ff9a6eacfb0 2023-07-22 07:08:10,600 INFO [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithSkipTmp/44342533261246d42cf6dd5082b72060/cf/da4d8f2249f649ff9eb260aee1f740cd, entries=46, sequenceid=6, filesize=13.2 K 2023-07-22 07:08:10,601 INFO [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 44342533261246d42cf6dd5082b72060 in 70ms, sequenceid=6, compaction requested=false 2023-07-22 07:08:10,601 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-22 07:08:10,602 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 44342533261246d42cf6dd5082b72060: 2023-07-22 07:08:10,602 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1690009689440.44342533261246d42cf6dd5082b72060.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,602 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 07:08:10,602 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithSkipTmp/44342533261246d42cf6dd5082b72060/cf/da4d8f2249f649ff9eb260aee1f740cd] hfiles 2023-07-22 07:08:10,602 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithSkipTmp/44342533261246d42cf6dd5082b72060/cf/da4d8f2249f649ff9eb260aee1f740cd for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,603 INFO [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithSkipTmp/1c83a1e9c42a66e88599bd591efaa978/cf/d5a1c81c34224fabad172ff9a6eacfb0, entries=4, sequenceid=6, filesize=5.6 K 2023-07-22 07:08:10,604 INFO [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 1c83a1e9c42a66e88599bd591efaa978 in 73ms, sequenceid=6, compaction requested=false 2023-07-22 07:08:10,606 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1c83a1e9c42a66e88599bd591efaa978: 2023-07-22 07:08:10,606 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1690009689440.1c83a1e9c42a66e88599bd591efaa978.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,606 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 07:08:10,606 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithSkipTmp/1c83a1e9c42a66e88599bd591efaa978/cf/d5a1c81c34224fabad172ff9a6eacfb0] hfiles 2023-07-22 07:08:10,606 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithSkipTmp/1c83a1e9c42a66e88599bd591efaa978/cf/d5a1c81c34224fabad172ff9a6eacfb0 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,619 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690009689440.44342533261246d42cf6dd5082b72060. completed. 2023-07-22 07:08:10,619 DEBUG [rs(jenkins-hbase4.apache.org,34707,1690009574173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690009689440.44342533261246d42cf6dd5082b72060. 2023-07-22 07:08:10,619 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 07:08:10,619 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 07:08:10,619 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:08:10,622 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-22 07:08:10,623 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34707,1690009574173' in zk 2023-07-22 07:08:10,624 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-22 07:08:10,625 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:08:10,625 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:08:10,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:08:10,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:08:10,625 DEBUG [member: 'jenkins-hbase4.apache.org,34707,1690009574173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-22 07:08:10,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:08:10,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:08:10,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:08:10,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:08:10,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:08:10,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:08:10,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:08:10,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:08:10,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:08:10,638 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690009689440.1c83a1e9c42a66e88599bd591efaa978. completed. 2023-07-22 07:08:10,638 DEBUG [rs(jenkins-hbase4.apache.org,44269,1690009574260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690009689440.1c83a1e9c42a66e88599bd591efaa978. 2023-07-22 07:08:10,638 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 07:08:10,638 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 07:08:10,639 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:08:10,639 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-22 07:08:10,639 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44269,1690009574260' in zk 2023-07-22 07:08:10,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,34707,1690009574173': 2023-07-22 07:08:10,639 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34707,1690009574173' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-22 07:08:10,640 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-22 07:08:10,640 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:08:10,640 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:08:10,640 DEBUG [member: 'jenkins-hbase4.apache.org,44269,1690009574260' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-22 07:08:10,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:08:10,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:08:10,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:08:10,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:08:10,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:08:10,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:08:10,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:08:10,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:08:10,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:08:10,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:08:10,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:08:10,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:08:10,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,44269,1690009574260': 2023-07-22 07:08:10,647 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44269,1690009574260' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-22 07:08:10,647 INFO [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-22 07:08:10,647 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 07:08:10,647 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 07:08:10,647 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,647 INFO [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 07:08:10,649 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,649 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,649 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,649 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:08:10,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,649 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:08:10,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 07:08:10,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 07:08:10,649 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,650 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:08:10,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:08:10,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:08:10,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:08:10,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:08:10,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:08:10,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:08:10,651 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:08:10,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 07:08:10,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,651 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:08:10,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,652 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:08:10,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 07:08:10,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:08:10,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:08:10,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:08:10,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 07:08:10,654 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:08:10,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,655 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:08:10,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:08:10,655 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:08:10,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:08:10,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:08:10,659 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:08:10,659 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,659 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:08:10,659 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:08:10,659 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:08:10,659 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,659 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:08:10,659 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,659 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:08:10,659 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 07:08:10,659 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,659 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:08:10,659 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:08:10,659 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:08:10,659 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:08:10,659 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 07:08:10,659 DEBUG [(jenkins-hbase4.apache.org,44609,1690009572558)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 07:08:10,659 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:08:10,660 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:08:10,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 07:08:10,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:08:10,659 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-22 07:08:10,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:08:10,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 07:08:10,661 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:08:10,662 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:08:10,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:08:10,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:08:10,663 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307222efcc1c8e0b74aa4857044e5eb37f7da, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023072200126dd0b87146e0a4dcf16d620f450a] mob files 2023-07-22 07:08:10,663 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307222efcc1c8e0b74aa4857044e5eb37f7da 2023-07-22 07:08:10,663 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023072200126dd0b87146e0a4dcf16d620f450a 2023-07-22 07:08:10,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 07:08:10,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 07:08:10,682 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,683 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,745 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,787 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 07:08:10,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-22 07:08:10,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-22 07:08:10,789 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-22 07:08:10,790 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-22 07:08:10,790 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,791 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:10,791 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1690009690484Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1690009690682 (+198 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1690009690682Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1690009690683 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1690009690705 (+22 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1690009690732 (+27 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1690009690790 (+58 ms) 2023-07-22 07:08:10,794 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-22 07:08:10,795 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 309 msec 2023-07-22 07:08:11,089 DEBUG [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 07:08:11,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-22 07:08:11,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 07:08:11,091 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009691091 2023-07-22 07:08:11,091 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:45491, tgtDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009691091, rawTgtDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009691091, srcFsUri=hdfs://localhost:45491, srcDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03 2023-07-22 07:08:11,116 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:45491, inputRoot=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03 2023-07-22 07:08:11,116 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1891880358_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009691091, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009691091/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:11,116 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:45491, inputRoot=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03, snapshotDir=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-22 07:08:11,133 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009691091/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:11,158 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-22 07:08:11,158 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-22 07:08:11,159 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-22 07:08:11,159 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-22 07:08:11,160 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-22 07:08:11,160 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-22 07:08:11,161 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-22 07:08:11,242 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/hadoop-6501883636812117177.jar 2023-07-22 07:08:11,243 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-22 07:08:11,243 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-22 07:08:11,243 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-22 07:08:11,244 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-22 07:08:11,244 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-22 07:08:11,244 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-22 07:08:11,245 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-22 07:08:11,245 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-22 07:08:11,246 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-22 07:08:11,246 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-22 07:08:11,246 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-22 07:08:11,247 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-22 07:08:11,247 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-22 07:08:11,248 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-22 07:08:11,248 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-22 07:08:11,249 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-22 07:08:11,249 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 07:08:11,249 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 07:08:11,250 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 07:08:11,250 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 07:08:11,250 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 07:08:11,250 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 07:08:11,251 DEBUG [Listener at jenkins-hbase4.apache.org/45401] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 07:08:11,828 WARN [Listener at jenkins-hbase4.apache.org/45401] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-22 07:08:11,830 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-22 07:08:11,832 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-22 07:08:13,880 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 07:08:13,880 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 07:08:13,894 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690009582157_0006_000001 (auth:SIMPLE) 2023-07-22 07:08:14,278 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690009582157_0007_000001 (auth:SIMPLE) 2023-07-22 07:08:14,784 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 07:08:20,241 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690009582157_0007_000001 (auth:SIMPLE) 2023-07-22 07:08:22,577 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690009582157_0007_000001 (auth:SIMPLE) 2023-07-22 07:08:27,226 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690009582157_0007_000001 (auth:SIMPLE) 2023-07-22 07:08:29,088 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-22 07:08:29,089 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-22 07:08:29,104 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:29,104 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-22 07:08:29,107 INFO [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-22 07:08:29,107 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_663023864_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:29,107 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(367): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-22 07:08:29,108 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(367): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-22 07:08:29,108 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_663023864_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009691091/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009691091/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:29,108 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(367): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009691091/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-22 07:08:29,108 DEBUG [Listener at jenkins-hbase4.apache.org/45401] snapshot.TestExportSnapshot(367): hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/export-test/export-1690009691091/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-22 07:08:29,114 INFO [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:29,114 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:29,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:29,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-22 07:08:29,120 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690009709120"}]},"ts":"1690009709120"} 2023-07-22 07:08:29,123 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-22 07:08:29,124 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-22 07:08:29,126 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=1c83a1e9c42a66e88599bd591efaa978, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=44342533261246d42cf6dd5082b72060, UNASSIGN}] 2023-07-22 07:08:29,128 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=1c83a1e9c42a66e88599bd591efaa978, UNASSIGN 2023-07-22 07:08:29,128 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=44342533261246d42cf6dd5082b72060, UNASSIGN 2023-07-22 07:08:29,129 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=1c83a1e9c42a66e88599bd591efaa978, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:08:29,129 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=44342533261246d42cf6dd5082b72060, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:08:29,129 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690009689440.1c83a1e9c42a66e88599bd591efaa978.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690009709129"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690009709129"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690009709129"}]},"ts":"1690009709129"} 2023-07-22 07:08:29,130 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690009689440.44342533261246d42cf6dd5082b72060.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690009709129"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690009709129"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690009709129"}]},"ts":"1690009709129"} 2023-07-22 07:08:29,131 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 1c83a1e9c42a66e88599bd591efaa978, server=jenkins-hbase4.apache.org,44269,1690009574260}] 2023-07-22 07:08:29,135 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 44342533261246d42cf6dd5082b72060, server=jenkins-hbase4.apache.org,34707,1690009574173}] 2023-07-22 07:08:29,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-22 07:08:29,287 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1c83a1e9c42a66e88599bd591efaa978 2023-07-22 07:08:29,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1c83a1e9c42a66e88599bd591efaa978, disabling compactions & flushes 2023-07-22 07:08:29,287 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1690009689440.1c83a1e9c42a66e88599bd591efaa978. 2023-07-22 07:08:29,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690009689440.1c83a1e9c42a66e88599bd591efaa978. 2023-07-22 07:08:29,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690009689440.1c83a1e9c42a66e88599bd591efaa978. after waiting 0 ms 2023-07-22 07:08:29,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1690009689440.1c83a1e9c42a66e88599bd591efaa978. 2023-07-22 07:08:29,288 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 44342533261246d42cf6dd5082b72060 2023-07-22 07:08:29,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 44342533261246d42cf6dd5082b72060, disabling compactions & flushes 2023-07-22 07:08:29,288 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1690009689440.44342533261246d42cf6dd5082b72060. 2023-07-22 07:08:29,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690009689440.44342533261246d42cf6dd5082b72060. 2023-07-22 07:08:29,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690009689440.44342533261246d42cf6dd5082b72060. after waiting 0 ms 2023-07-22 07:08:29,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1690009689440.44342533261246d42cf6dd5082b72060. 2023-07-22 07:08:29,306 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithSkipTmp/1c83a1e9c42a66e88599bd591efaa978/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 07:08:29,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/default/testtb-testExportFileSystemStateWithSkipTmp/44342533261246d42cf6dd5082b72060/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 07:08:29,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 07:08:29,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 07:08:29,308 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1690009689440.1c83a1e9c42a66e88599bd591efaa978. 2023-07-22 07:08:29,308 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1690009689440.44342533261246d42cf6dd5082b72060. 2023-07-22 07:08:29,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1c83a1e9c42a66e88599bd591efaa978: 2023-07-22 07:08:29,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 44342533261246d42cf6dd5082b72060: 2023-07-22 07:08:29,311 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1c83a1e9c42a66e88599bd591efaa978 2023-07-22 07:08:29,312 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=1c83a1e9c42a66e88599bd591efaa978, regionState=CLOSED 2023-07-22 07:08:29,312 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690009689440.1c83a1e9c42a66e88599bd591efaa978.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690009709311"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690009709311"}]},"ts":"1690009709311"} 2023-07-22 07:08:29,312 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 44342533261246d42cf6dd5082b72060 2023-07-22 07:08:29,313 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=44342533261246d42cf6dd5082b72060, regionState=CLOSED 2023-07-22 07:08:29,313 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690009689440.44342533261246d42cf6dd5082b72060.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690009709313"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690009709313"}]},"ts":"1690009709313"} 2023-07-22 07:08:29,315 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-22 07:08:29,315 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 1c83a1e9c42a66e88599bd591efaa978, server=jenkins-hbase4.apache.org,44269,1690009574260 in 182 msec 2023-07-22 07:08:29,316 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-22 07:08:29,316 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 44342533261246d42cf6dd5082b72060, server=jenkins-hbase4.apache.org,34707,1690009574173 in 179 msec 2023-07-22 07:08:29,317 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=1c83a1e9c42a66e88599bd591efaa978, UNASSIGN in 189 msec 2023-07-22 07:08:29,318 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-22 07:08:29,318 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=44342533261246d42cf6dd5082b72060, UNASSIGN in 190 msec 2023-07-22 07:08:29,318 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690009709318"}]},"ts":"1690009709318"} 2023-07-22 07:08:29,320 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-22 07:08:29,321 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-22 07:08:29,323 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 208 msec 2023-07-22 07:08:29,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-22 07:08:29,422 INFO [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-22 07:08:29,423 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:29,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:29,426 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:29,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:29,427 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:29,428 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44269] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:29,432 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/1c83a1e9c42a66e88599bd591efaa978 2023-07-22 07:08:29,432 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/44342533261246d42cf6dd5082b72060 2023-07-22 07:08:29,434 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:29,434 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:29,434 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:29,434 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:29,434 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-22 07:08:29,434 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-22 07:08:29,435 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-22 07:08:29,434 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-22 07:08:29,435 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:29,435 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:29,435 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:08:29,435 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:29,435 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:29,435 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/1c83a1e9c42a66e88599bd591efaa978/cf, FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/1c83a1e9c42a66e88599bd591efaa978/recovered.edits] 2023-07-22 07:08:29,435 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:08:29,435 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:08:29,435 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 07:08:29,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-22 07:08:29,437 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/44342533261246d42cf6dd5082b72060/cf, FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/44342533261246d42cf6dd5082b72060/recovered.edits] 2023-07-22 07:08:29,441 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/1c83a1e9c42a66e88599bd591efaa978/cf/d5a1c81c34224fabad172ff9a6eacfb0 to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/1c83a1e9c42a66e88599bd591efaa978/cf/d5a1c81c34224fabad172ff9a6eacfb0 2023-07-22 07:08:29,443 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/44342533261246d42cf6dd5082b72060/cf/da4d8f2249f649ff9eb260aee1f740cd to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/44342533261246d42cf6dd5082b72060/cf/da4d8f2249f649ff9eb260aee1f740cd 2023-07-22 07:08:29,446 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/1c83a1e9c42a66e88599bd591efaa978/recovered.edits/9.seqid to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/1c83a1e9c42a66e88599bd591efaa978/recovered.edits/9.seqid 2023-07-22 07:08:29,446 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/1c83a1e9c42a66e88599bd591efaa978 2023-07-22 07:08:29,446 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/44342533261246d42cf6dd5082b72060/recovered.edits/9.seqid to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/44342533261246d42cf6dd5082b72060/recovered.edits/9.seqid 2023-07-22 07:08:29,447 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/44342533261246d42cf6dd5082b72060 2023-07-22 07:08:29,447 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-22 07:08:29,447 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-22 07:08:29,448 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-22 07:08:29,453 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307222efcc1c8e0b74aa4857044e5eb37f7da to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307222efcc1c8e0b74aa4857044e5eb37f7da 2023-07-22 07:08:29,455 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023072200126dd0b87146e0a4dcf16d620f450a to hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023072200126dd0b87146e0a4dcf16d620f450a 2023-07-22 07:08:29,456 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-22 07:08:29,458 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:29,462 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-22 07:08:29,465 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-22 07:08:29,466 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:29,466 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-22 07:08:29,467 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690009689440.1c83a1e9c42a66e88599bd591efaa978.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690009709466"}]},"ts":"9223372036854775807"} 2023-07-22 07:08:29,467 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690009689440.44342533261246d42cf6dd5082b72060.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690009709466"}]},"ts":"9223372036854775807"} 2023-07-22 07:08:29,469 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-22 07:08:29,469 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 1c83a1e9c42a66e88599bd591efaa978, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690009689440.1c83a1e9c42a66e88599bd591efaa978.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 44342533261246d42cf6dd5082b72060, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690009689440.44342533261246d42cf6dd5082b72060.', STARTKEY => '1', ENDKEY => ''}] 2023-07-22 07:08:29,469 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-22 07:08:29,469 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690009709469"}]},"ts":"9223372036854775807"} 2023-07-22 07:08:29,471 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-22 07:08:29,473 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:29,474 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 50 msec 2023-07-22 07:08:29,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-22 07:08:29,538 INFO [Listener at jenkins-hbase4.apache.org/45401] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-22 07:08:29,546 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-22 07:08:29,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:29,550 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-22 07:08:29,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44609] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 07:08:29,581 INFO [Listener at jenkins-hbase4.apache.org/45401] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=762 (was 760) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1203180535) connection to jenkins-hbase4.apache.org/172.31.14.131:36785 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x6ff205ea-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5432 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_663023864_17 at /127.0.0.1:45608 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6ff205ea-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6ff205ea-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6ff205ea-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_663023864_17 at /127.0.0.1:58466 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1939354754_1 at /127.0.0.1:45580 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=908 (was 910), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=536 (was 562), ProcessCount=177 (was 180), AvailableMemoryMB=5314 (was 5396) 2023-07-22 07:08:29,581 WARN [Listener at jenkins-hbase4.apache.org/45401] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-22 07:08:29,581 INFO [Listener at jenkins-hbase4.apache.org/45401] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-22 07:08:29,592 INFO [Listener at jenkins-hbase4.apache.org/45401] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-22 07:08:33,413 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690009582157_0007_000001 (auth:SIMPLE) 2023-07-22 07:08:34,882 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 07:08:43,715 INFO [Listener at jenkins-hbase4.apache.org/45401] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-22 07:08:57,846 ERROR [Thread[Thread-411,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-22 07:08:57,847 INFO [Listener at jenkins-hbase4.apache.org/45401] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-22 07:08:57,963 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-22 07:08:57,973 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-22 07:08:57,974 ERROR [Thread[Thread-421,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-22 07:08:57,984 INFO [Listener at jenkins-hbase4.apache.org/45401] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-22 07:08:58,090 ERROR [Thread[Thread-386,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-22 07:08:58,090 INFO [Listener at jenkins-hbase4.apache.org/45401] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-22 07:08:58,091 INFO [Listener at jenkins-hbase4.apache.org/45401] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-22 07:08:58,091 INFO [Listener at jenkins-hbase4.apache.org/45401] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-22 07:08:58,091 DEBUG [Listener at jenkins-hbase4.apache.org/45401] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x683dee07 to 127.0.0.1:63277 2023-07-22 07:08:58,091 DEBUG [Listener at jenkins-hbase4.apache.org/45401] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 07:08:58,091 DEBUG [Listener at jenkins-hbase4.apache.org/45401] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-22 07:08:58,091 DEBUG [Listener at jenkins-hbase4.apache.org/45401] util.JVMClusterUtil(257): Found active master hash=145868615, stopped=false 2023-07-22 07:08:58,091 DEBUG [Listener at jenkins-hbase4.apache.org/45401] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 07:08:58,092 DEBUG [Listener at jenkins-hbase4.apache.org/45401] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-22 07:08:58,092 INFO [Listener at jenkins-hbase4.apache.org/45401] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,44609,1690009572558 2023-07-22 07:08:58,093 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-22 07:08:58,093 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-22 07:08:58,093 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-22 07:08:58,093 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 07:08:58,093 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-22 07:08:58,094 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 07:08:58,094 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 07:08:58,094 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 07:08:58,094 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 07:08:58,094 INFO [Listener at jenkins-hbase4.apache.org/45401] procedure2.ProcedureExecutor(629): Stopping 2023-07-22 07:08:58,095 DEBUG [Listener at jenkins-hbase4.apache.org/45401] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3efff31b to 127.0.0.1:63277 2023-07-22 07:08:58,095 DEBUG [Listener at jenkins-hbase4.apache.org/45401] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 07:08:58,095 INFO [Listener at jenkins-hbase4.apache.org/45401] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,34707,1690009574173' ***** 2023-07-22 07:08:58,095 DEBUG [Listener at jenkins-hbase4.apache.org/45401] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 07:08:58,095 INFO [Listener at jenkins-hbase4.apache.org/45401] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-22 07:08:58,096 INFO [Listener at jenkins-hbase4.apache.org/45401] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,44269,1690009574260' ***** 2023-07-22 07:08:58,096 DEBUG [Listener at jenkins-hbase4.apache.org/45401] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 07:08:58,096 INFO [Listener at jenkins-hbase4.apache.org/45401] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-22 07:08:58,096 INFO [RS:0;jenkins-hbase4:34707] regionserver.HeapMemoryManager(220): Stopping 2023-07-22 07:08:58,096 INFO [Listener at jenkins-hbase4.apache.org/45401] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43271,1690009574333' ***** 2023-07-22 07:08:58,096 DEBUG [Listener at jenkins-hbase4.apache.org/45401] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 07:08:58,096 INFO [Listener at jenkins-hbase4.apache.org/45401] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-22 07:08:58,096 INFO [RS:1;jenkins-hbase4:44269] regionserver.HeapMemoryManager(220): Stopping 2023-07-22 07:08:58,096 INFO [RS:1;jenkins-hbase4:44269] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-22 07:08:58,096 INFO [RS:2;jenkins-hbase4:43271] regionserver.HeapMemoryManager(220): Stopping 2023-07-22 07:08:58,096 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-22 07:08:58,096 INFO [RS:2;jenkins-hbase4:43271] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-22 07:08:58,096 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-22 07:08:58,096 INFO [RS:0;jenkins-hbase4:34707] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-22 07:08:58,097 INFO [RS:2;jenkins-hbase4:43271] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-22 07:08:58,096 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-22 07:08:58,097 INFO [RS:2;jenkins-hbase4:43271] regionserver.HRegionServer(3305): Received CLOSE for cbb2a096252f6b642113307201fd6b04 2023-07-22 07:08:58,098 INFO [RS:2;jenkins-hbase4:43271] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:08:58,098 DEBUG [RS:2;jenkins-hbase4:43271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6465126b to 127.0.0.1:63277 2023-07-22 07:08:58,098 DEBUG [RS:2;jenkins-hbase4:43271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 07:08:58,096 INFO [RS:1;jenkins-hbase4:44269] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-22 07:08:58,099 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cbb2a096252f6b642113307201fd6b04, disabling compactions & flushes 2023-07-22 07:08:58,106 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690009577208.cbb2a096252f6b642113307201fd6b04. 2023-07-22 07:08:58,097 INFO [RS:0;jenkins-hbase4:34707] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-22 07:08:58,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690009577208.cbb2a096252f6b642113307201fd6b04. 2023-07-22 07:08:58,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690009577208.cbb2a096252f6b642113307201fd6b04. after waiting 0 ms 2023-07-22 07:08:58,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690009577208.cbb2a096252f6b642113307201fd6b04. 2023-07-22 07:08:58,106 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing cbb2a096252f6b642113307201fd6b04 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-22 07:08:58,106 INFO [RS:1;jenkins-hbase4:44269] regionserver.HRegionServer(3305): Received CLOSE for ffac00db7cc9550566202da8d7404f2e 2023-07-22 07:08:58,106 INFO [RS:1;jenkins-hbase4:44269] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:08:58,106 DEBUG [RS:1;jenkins-hbase4:44269] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3b7512a5 to 127.0.0.1:63277 2023-07-22 07:08:58,106 DEBUG [RS:1;jenkins-hbase4:44269] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 07:08:58,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ffac00db7cc9550566202da8d7404f2e, disabling compactions & flushes 2023-07-22 07:08:58,105 INFO [RS:2;jenkins-hbase4:43271] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-22 07:08:58,111 INFO [RS:2;jenkins-hbase4:43271] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-22 07:08:58,111 INFO [RS:2;jenkins-hbase4:43271] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-22 07:08:58,111 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690009578074.ffac00db7cc9550566202da8d7404f2e. 2023-07-22 07:08:58,111 INFO [RS:2;jenkins-hbase4:43271] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-22 07:08:58,108 INFO [RS:1;jenkins-hbase4:44269] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-22 07:08:58,111 DEBUG [RS:1;jenkins-hbase4:44269] regionserver.HRegionServer(1478): Online Regions={ffac00db7cc9550566202da8d7404f2e=hbase:acl,,1690009578074.ffac00db7cc9550566202da8d7404f2e.} 2023-07-22 07:08:58,112 DEBUG [RS:1;jenkins-hbase4:44269] regionserver.HRegionServer(1504): Waiting on ffac00db7cc9550566202da8d7404f2e 2023-07-22 07:08:58,106 INFO [RS:0;jenkins-hbase4:34707] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:08:58,112 DEBUG [RS:0;jenkins-hbase4:34707] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6f48a187 to 127.0.0.1:63277 2023-07-22 07:08:58,112 DEBUG [RS:0;jenkins-hbase4:34707] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 07:08:58,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690009578074.ffac00db7cc9550566202da8d7404f2e. 2023-07-22 07:08:58,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690009578074.ffac00db7cc9550566202da8d7404f2e. after waiting 0 ms 2023-07-22 07:08:58,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690009578074.ffac00db7cc9550566202da8d7404f2e. 2023-07-22 07:08:58,113 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing ffac00db7cc9550566202da8d7404f2e 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-22 07:08:58,117 INFO [RS:2;jenkins-hbase4:43271] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-22 07:08:58,118 INFO [RS:0;jenkins-hbase4:34707] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,34707,1690009574173; all regions closed. 2023-07-22 07:08:58,118 DEBUG [RS:2;jenkins-hbase4:43271] regionserver.HRegionServer(1478): Online Regions={cbb2a096252f6b642113307201fd6b04=hbase:namespace,,1690009577208.cbb2a096252f6b642113307201fd6b04., 1588230740=hbase:meta,,1.1588230740} 2023-07-22 07:08:58,118 DEBUG [RS:2;jenkins-hbase4:43271] regionserver.HRegionServer(1504): Waiting on 1588230740, cbb2a096252f6b642113307201fd6b04 2023-07-22 07:08:58,143 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-22 07:08:58,143 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-22 07:08:58,143 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-22 07:08:58,143 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-22 07:08:58,143 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-22 07:08:58,143 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-22 07:08:58,157 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-22 07:08:58,160 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-22 07:08:58,167 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-22 07:08:58,229 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/namespace/cbb2a096252f6b642113307201fd6b04/.tmp/info/f5bbc48e409a4761af8966eaf113b461 2023-07-22 07:08:58,243 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/meta/1588230740/.tmp/info/6d6fd1f98d77422e86f3dd3b297bfc3b 2023-07-22 07:08:58,249 DEBUG [RS:0;jenkins-hbase4:34707] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/oldWALs 2023-07-22 07:08:58,250 INFO [RS:0;jenkins-hbase4:34707] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34707%2C1690009574173:(num 1690009576468) 2023-07-22 07:08:58,250 DEBUG [RS:0;jenkins-hbase4:34707] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 07:08:58,250 INFO [RS:0;jenkins-hbase4:34707] regionserver.LeaseManager(133): Closed leases 2023-07-22 07:08:58,251 INFO [RS:0;jenkins-hbase4:34707] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-22 07:08:58,251 INFO [RS:0;jenkins-hbase4:34707] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-22 07:08:58,251 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-22 07:08:58,251 INFO [RS:0;jenkins-hbase4:34707] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-22 07:08:58,251 INFO [RS:0;jenkins-hbase4:34707] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-22 07:08:58,253 INFO [RS:0;jenkins-hbase4:34707] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34707 2023-07-22 07:08:58,254 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/acl/ffac00db7cc9550566202da8d7404f2e/.tmp/l/2e83c12a610c4f71aa5e3d8baf1004db 2023-07-22 07:08:58,268 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6d6fd1f98d77422e86f3dd3b297bfc3b 2023-07-22 07:08:58,276 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2e83c12a610c4f71aa5e3d8baf1004db 2023-07-22 07:08:58,279 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/acl/ffac00db7cc9550566202da8d7404f2e/.tmp/l/2e83c12a610c4f71aa5e3d8baf1004db as hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/acl/ffac00db7cc9550566202da8d7404f2e/l/2e83c12a610c4f71aa5e3d8baf1004db 2023-07-22 07:08:58,279 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:08:58,279 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 07:08:58,279 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:08:58,279 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 07:08:58,279 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34707,1690009574173 2023-07-22 07:08:58,279 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 07:08:58,279 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 07:08:58,282 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/namespace/cbb2a096252f6b642113307201fd6b04/.tmp/info/f5bbc48e409a4761af8966eaf113b461 as hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/namespace/cbb2a096252f6b642113307201fd6b04/info/f5bbc48e409a4761af8966eaf113b461 2023-07-22 07:08:58,286 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-22 07:08:58,286 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-22 07:08:58,287 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34707,1690009574173] 2023-07-22 07:08:58,288 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2e83c12a610c4f71aa5e3d8baf1004db 2023-07-22 07:08:58,288 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/acl/ffac00db7cc9550566202da8d7404f2e/l/2e83c12a610c4f71aa5e3d8baf1004db, entries=7, sequenceid=18, filesize=5.2 K 2023-07-22 07:08:58,289 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for ffac00db7cc9550566202da8d7404f2e in 176ms, sequenceid=18, compaction requested=false 2023-07-22 07:08:58,291 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/namespace/cbb2a096252f6b642113307201fd6b04/info/f5bbc48e409a4761af8966eaf113b461, entries=2, sequenceid=6, filesize=4.8 K 2023-07-22 07:08:58,293 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for cbb2a096252f6b642113307201fd6b04 in 187ms, sequenceid=6, compaction requested=false 2023-07-22 07:08:58,301 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34707,1690009574173; numProcessing=1 2023-07-22 07:08:58,302 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34707,1690009574173 already deleted, retry=false 2023-07-22 07:08:58,302 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34707,1690009574173 expired; onlineServers=2 2023-07-22 07:08:58,304 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-22 07:08:58,304 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-22 07:08:58,312 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/meta/1588230740/.tmp/rep_barrier/35ed83471b7f4515b088427daf6f48d2 2023-07-22 07:08:58,313 DEBUG [RS:1;jenkins-hbase4:44269] regionserver.HRegionServer(1504): Waiting on ffac00db7cc9550566202da8d7404f2e 2023-07-22 07:08:58,315 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/acl/ffac00db7cc9550566202da8d7404f2e/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-22 07:08:58,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 07:08:58,317 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1690009578074.ffac00db7cc9550566202da8d7404f2e. 2023-07-22 07:08:58,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ffac00db7cc9550566202da8d7404f2e: 2023-07-22 07:08:58,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1690009578074.ffac00db7cc9550566202da8d7404f2e. 2023-07-22 07:08:58,319 DEBUG [RS:2;jenkins-hbase4:43271] regionserver.HRegionServer(1504): Waiting on 1588230740, cbb2a096252f6b642113307201fd6b04 2023-07-22 07:08:58,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/namespace/cbb2a096252f6b642113307201fd6b04/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 07:08:58,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 07:08:58,322 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690009577208.cbb2a096252f6b642113307201fd6b04. 2023-07-22 07:08:58,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cbb2a096252f6b642113307201fd6b04: 2023-07-22 07:08:58,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1690009577208.cbb2a096252f6b642113307201fd6b04. 2023-07-22 07:08:58,323 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 35ed83471b7f4515b088427daf6f48d2 2023-07-22 07:08:58,384 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 07:08:58,384 INFO [RS:0;jenkins-hbase4:34707] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,34707,1690009574173; zookeeper connection closed. 2023-07-22 07:08:58,385 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:34707-0x1018bda14210001, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 07:08:58,385 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@42ad3c16] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@42ad3c16 2023-07-22 07:08:58,513 INFO [RS:1;jenkins-hbase4:44269] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,44269,1690009574260; all regions closed. 2023-07-22 07:08:58,519 DEBUG [RS:2;jenkins-hbase4:43271] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-22 07:08:58,534 DEBUG [RS:1;jenkins-hbase4:44269] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/oldWALs 2023-07-22 07:08:58,534 INFO [RS:1;jenkins-hbase4:44269] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44269%2C1690009574260:(num 1690009576467) 2023-07-22 07:08:58,534 DEBUG [RS:1;jenkins-hbase4:44269] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 07:08:58,534 INFO [RS:1;jenkins-hbase4:44269] regionserver.LeaseManager(133): Closed leases 2023-07-22 07:08:58,535 INFO [RS:1;jenkins-hbase4:44269] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-22 07:08:58,536 INFO [RS:1;jenkins-hbase4:44269] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-22 07:08:58,536 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-22 07:08:58,536 INFO [RS:1;jenkins-hbase4:44269] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-22 07:08:58,536 INFO [RS:1;jenkins-hbase4:44269] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-22 07:08:58,538 INFO [RS:1;jenkins-hbase4:44269] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44269 2023-07-22 07:08:58,540 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:08:58,540 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44269,1690009574260 2023-07-22 07:08:58,540 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 07:08:58,542 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44269,1690009574260] 2023-07-22 07:08:58,542 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44269,1690009574260; numProcessing=2 2023-07-22 07:08:58,545 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44269,1690009574260 already deleted, retry=false 2023-07-22 07:08:58,545 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44269,1690009574260 expired; onlineServers=1 2023-07-22 07:08:58,642 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 07:08:58,642 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:44269-0x1018bda14210002, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 07:08:58,642 INFO [RS:1;jenkins-hbase4:44269] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,44269,1690009574260; zookeeper connection closed. 2023-07-22 07:08:58,643 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@66fd69f6] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@66fd69f6 2023-07-22 07:08:58,719 DEBUG [RS:2;jenkins-hbase4:43271] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-22 07:08:58,737 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/meta/1588230740/.tmp/table/a115ca7bc84d4039a70d73844ed3736a 2023-07-22 07:08:58,744 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a115ca7bc84d4039a70d73844ed3736a 2023-07-22 07:08:58,745 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/meta/1588230740/.tmp/info/6d6fd1f98d77422e86f3dd3b297bfc3b as hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/meta/1588230740/info/6d6fd1f98d77422e86f3dd3b297bfc3b 2023-07-22 07:08:58,751 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6d6fd1f98d77422e86f3dd3b297bfc3b 2023-07-22 07:08:58,752 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/meta/1588230740/info/6d6fd1f98d77422e86f3dd3b297bfc3b, entries=48, sequenceid=131, filesize=10.3 K 2023-07-22 07:08:58,753 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/meta/1588230740/.tmp/rep_barrier/35ed83471b7f4515b088427daf6f48d2 as hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/meta/1588230740/rep_barrier/35ed83471b7f4515b088427daf6f48d2 2023-07-22 07:08:58,759 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 35ed83471b7f4515b088427daf6f48d2 2023-07-22 07:08:58,759 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/meta/1588230740/rep_barrier/35ed83471b7f4515b088427daf6f48d2, entries=13, sequenceid=131, filesize=6.4 K 2023-07-22 07:08:58,760 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/meta/1588230740/.tmp/table/a115ca7bc84d4039a70d73844ed3736a as hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/meta/1588230740/table/a115ca7bc84d4039a70d73844ed3736a 2023-07-22 07:08:58,769 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a115ca7bc84d4039a70d73844ed3736a 2023-07-22 07:08:58,769 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/meta/1588230740/table/a115ca7bc84d4039a70d73844ed3736a, entries=24, sequenceid=131, filesize=6.9 K 2023-07-22 07:08:58,770 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 627ms, sequenceid=131, compaction requested=false 2023-07-22 07:08:58,788 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-22 07:08:58,789 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 07:08:58,789 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-22 07:08:58,789 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-22 07:08:58,789 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-22 07:08:58,790 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-22 07:08:58,919 INFO [RS:2;jenkins-hbase4:43271] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43271,1690009574333; all regions closed. 2023-07-22 07:08:58,955 DEBUG [RS:2;jenkins-hbase4:43271] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/oldWALs 2023-07-22 07:08:58,955 INFO [RS:2;jenkins-hbase4:43271] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43271%2C1690009574333.meta:.meta(num 1690009576837) 2023-07-22 07:08:58,979 DEBUG [RS:2;jenkins-hbase4:43271] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/oldWALs 2023-07-22 07:08:58,979 INFO [RS:2;jenkins-hbase4:43271] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43271%2C1690009574333:(num 1690009576496) 2023-07-22 07:08:58,979 DEBUG [RS:2;jenkins-hbase4:43271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 07:08:58,979 INFO [RS:2;jenkins-hbase4:43271] regionserver.LeaseManager(133): Closed leases 2023-07-22 07:08:58,979 INFO [RS:2;jenkins-hbase4:43271] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-22 07:08:58,979 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-22 07:08:58,981 INFO [RS:2;jenkins-hbase4:43271] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43271 2023-07-22 07:08:58,983 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 07:08:58,983 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43271,1690009574333 2023-07-22 07:08:58,983 ERROR [Listener at localhost/45423-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2aa68faf rejected from java.util.concurrent.ThreadPoolExecutor@2e990e23[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 112] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1374) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:603) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-07-22 07:08:58,983 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43271,1690009574333] 2023-07-22 07:08:58,983 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43271,1690009574333; numProcessing=3 2023-07-22 07:08:58,985 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43271,1690009574333 already deleted, retry=false 2023-07-22 07:08:58,985 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43271,1690009574333 expired; onlineServers=0 2023-07-22 07:08:58,985 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,44609,1690009572558' ***** 2023-07-22 07:08:58,985 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-22 07:08:58,985 DEBUG [M:0;jenkins-hbase4:44609] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@498ccd7c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-22 07:08:58,985 INFO [M:0;jenkins-hbase4:44609] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,44609,1690009572558 2023-07-22 07:08:58,985 INFO [M:0;jenkins-hbase4:44609] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,44609,1690009572558; all regions closed. 2023-07-22 07:08:58,985 DEBUG [M:0;jenkins-hbase4:44609] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 07:08:58,985 DEBUG [M:0;jenkins-hbase4:44609] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-22 07:08:58,985 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-22 07:08:58,985 DEBUG [M:0;jenkins-hbase4:44609] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-22 07:08:58,985 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690009575922] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690009575922,5,FailOnTimeoutGroup] 2023-07-22 07:08:58,985 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690009575921] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690009575921,5,FailOnTimeoutGroup] 2023-07-22 07:08:58,986 INFO [M:0;jenkins-hbase4:44609] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-22 07:08:58,986 INFO [M:0;jenkins-hbase4:44609] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-22 07:08:58,986 INFO [M:0;jenkins-hbase4:44609] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-22 07:08:58,986 DEBUG [M:0;jenkins-hbase4:44609] master.HMaster(1512): Stopping service threads 2023-07-22 07:08:58,986 INFO [M:0;jenkins-hbase4:44609] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-22 07:08:58,986 ERROR [M:0;jenkins-hbase4:44609] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-22 07:08:58,987 INFO [M:0;jenkins-hbase4:44609] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-22 07:08:58,987 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-22 07:08:58,987 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-22 07:08:58,987 DEBUG [M:0;jenkins-hbase4:44609] zookeeper.ZKUtil(398): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-22 07:08:58,988 WARN [M:0;jenkins-hbase4:44609] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-22 07:08:58,988 INFO [M:0;jenkins-hbase4:44609] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-22 07:08:58,988 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 07:08:58,988 INFO [M:0;jenkins-hbase4:44609] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-22 07:08:58,989 DEBUG [M:0;jenkins-hbase4:44609] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-22 07:08:58,989 INFO [M:0;jenkins-hbase4:44609] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 07:08:58,989 DEBUG [M:0;jenkins-hbase4:44609] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 07:08:58,989 DEBUG [M:0;jenkins-hbase4:44609] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-22 07:08:58,989 DEBUG [M:0;jenkins-hbase4:44609] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 07:08:58,989 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-22 07:08:58,989 INFO [M:0;jenkins-hbase4:44609] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.65 KB heapSize=451.94 KB 2023-07-22 07:08:59,033 INFO [M:0;jenkins-hbase4:44609] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.65 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d86ec017ab4b445fa0261bd0b6184ee9 2023-07-22 07:08:59,041 INFO [M:0;jenkins-hbase4:44609] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d86ec017ab4b445fa0261bd0b6184ee9 2023-07-22 07:08:59,043 DEBUG [M:0;jenkins-hbase4:44609] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d86ec017ab4b445fa0261bd0b6184ee9 as hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d86ec017ab4b445fa0261bd0b6184ee9 2023-07-22 07:08:59,050 INFO [M:0;jenkins-hbase4:44609] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d86ec017ab4b445fa0261bd0b6184ee9 2023-07-22 07:08:59,050 INFO [M:0;jenkins-hbase4:44609] regionserver.HStore(1080): Added hdfs://localhost:45491/user/jenkins/test-data/720e3a73-d94d-bf1e-0722-481a71171e03/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d86ec017ab4b445fa0261bd0b6184ee9, entries=119, sequenceid=899, filesize=28.6 K 2023-07-22 07:08:59,055 INFO [M:0;jenkins-hbase4:44609] regionserver.HRegion(2948): Finished flush of dataSize ~375.65 KB/384663, heapSize ~451.92 KB/462768, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 66ms, sequenceid=899, compaction requested=false 2023-07-22 07:08:59,064 INFO [M:0;jenkins-hbase4:44609] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 07:08:59,064 DEBUG [M:0;jenkins-hbase4:44609] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-22 07:08:59,078 INFO [M:0;jenkins-hbase4:44609] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-22 07:08:59,078 INFO [M:0;jenkins-hbase4:44609] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44609 2023-07-22 07:08:59,078 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-22 07:08:59,080 DEBUG [M:0;jenkins-hbase4:44609] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,44609,1690009572558 already deleted, retry=false 2023-07-22 07:08:59,084 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 07:08:59,084 INFO [RS:2;jenkins-hbase4:43271] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43271,1690009574333; zookeeper connection closed. 2023-07-22 07:08:59,084 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): regionserver:43271-0x1018bda14210003, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 07:08:59,089 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@65518da3] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@65518da3 2023-07-22 07:08:59,089 INFO [Listener at jenkins-hbase4.apache.org/45401] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-22 07:08:59,184 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 07:08:59,184 INFO [M:0;jenkins-hbase4:44609] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,44609,1690009572558; zookeeper connection closed. 2023-07-22 07:08:59,184 DEBUG [Listener at localhost/45423-EventThread] zookeeper.ZKWatcher(600): master:44609-0x1018bda14210000, quorum=127.0.0.1:63277, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 07:08:59,187 WARN [Listener at jenkins-hbase4.apache.org/45401] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-22 07:08:59,191 INFO [Listener at jenkins-hbase4.apache.org/45401] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-22 07:08:59,295 WARN [BP-1281437129-172.31.14.131-1690009568512 heartbeating to localhost/127.0.0.1:45491] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-22 07:08:59,295 WARN [BP-1281437129-172.31.14.131-1690009568512 heartbeating to localhost/127.0.0.1:45491] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1281437129-172.31.14.131-1690009568512 (Datanode Uuid 3d25e4ce-7a2c-4c2c-952d-ee7f4ad0ae86) service to localhost/127.0.0.1:45491 2023-07-22 07:08:59,297 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/cluster_09dad59a-c8af-d239-c3a5-237708feddb2/dfs/data/data5/current/BP-1281437129-172.31.14.131-1690009568512] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-22 07:08:59,297 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/cluster_09dad59a-c8af-d239-c3a5-237708feddb2/dfs/data/data6/current/BP-1281437129-172.31.14.131-1690009568512] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-22 07:08:59,299 WARN [Listener at jenkins-hbase4.apache.org/45401] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-22 07:08:59,303 INFO [Listener at jenkins-hbase4.apache.org/45401] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-22 07:08:59,409 WARN [BP-1281437129-172.31.14.131-1690009568512 heartbeating to localhost/127.0.0.1:45491] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-22 07:08:59,409 WARN [BP-1281437129-172.31.14.131-1690009568512 heartbeating to localhost/127.0.0.1:45491] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1281437129-172.31.14.131-1690009568512 (Datanode Uuid b58c9f20-69f4-4098-a29d-71c12173dfb4) service to localhost/127.0.0.1:45491 2023-07-22 07:08:59,410 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/cluster_09dad59a-c8af-d239-c3a5-237708feddb2/dfs/data/data3/current/BP-1281437129-172.31.14.131-1690009568512] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-22 07:08:59,410 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/cluster_09dad59a-c8af-d239-c3a5-237708feddb2/dfs/data/data4/current/BP-1281437129-172.31.14.131-1690009568512] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-22 07:08:59,419 WARN [Listener at jenkins-hbase4.apache.org/45401] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-22 07:08:59,428 INFO [Listener at jenkins-hbase4.apache.org/45401] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-22 07:08:59,430 WARN [BP-1281437129-172.31.14.131-1690009568512 heartbeating to localhost/127.0.0.1:45491] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-22 07:08:59,431 WARN [BP-1281437129-172.31.14.131-1690009568512 heartbeating to localhost/127.0.0.1:45491] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1281437129-172.31.14.131-1690009568512 (Datanode Uuid 793ad59e-b149-4edf-8edb-f9c772982824) service to localhost/127.0.0.1:45491 2023-07-22 07:08:59,431 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/cluster_09dad59a-c8af-d239-c3a5-237708feddb2/dfs/data/data1/current/BP-1281437129-172.31.14.131-1690009568512] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-22 07:08:59,431 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5f67798b-d9ab-0bff-73fa-3dec22890b19/cluster_09dad59a-c8af-d239-c3a5-237708feddb2/dfs/data/data2/current/BP-1281437129-172.31.14.131-1690009568512] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-22 07:08:59,457 INFO [Listener at jenkins-hbase4.apache.org/45401] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-22 07:08:59,587 INFO [Listener at jenkins-hbase4.apache.org/45401] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-22 07:08:59,708 INFO [Listener at jenkins-hbase4.apache.org/45401] hbase.HBaseTestingUtility(1293): Minicluster is down