2023-07-17 13:10:50,336 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-17 13:10:50,612 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0 2023-07-17 13:10:50,613 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-17 13:10:50,652 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-17 13:10:50,962 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-17 13:10:50,963 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/cluster_ebeb3e26-e5ee-6f23-45cc-cbe52345d6d9, deleteOnExit=true 2023-07-17 13:10:50,963 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-17 13:10:50,963 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/test.cache.data in system properties and HBase conf 2023-07-17 13:10:50,964 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/hadoop.tmp.dir in system properties and HBase conf 2023-07-17 13:10:50,964 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/hadoop.log.dir in system properties and HBase conf 2023-07-17 13:10:50,964 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-17 13:10:50,965 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-17 13:10:50,965 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-17 13:10:51,391 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-17 13:10:51,398 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-17 13:10:51,399 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-17 13:10:51,399 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-17 13:10:51,400 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-17 13:10:51,400 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-17 13:10:51,401 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-17 13:10:51,401 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-17 13:10:51,401 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-17 13:10:51,402 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-17 13:10:51,402 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/nfs.dump.dir in system properties and HBase conf 2023-07-17 13:10:51,403 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/java.io.tmpdir in system properties and HBase conf 2023-07-17 13:10:51,403 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-17 13:10:51,403 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-17 13:10:51,404 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-17 13:10:52,115 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-17 13:10:52,121 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-17 13:10:52,502 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-17 13:10:52,748 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-17 13:10:52,767 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 13:10:52,813 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 13:10:52,849 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/java.io.tmpdir/Jetty_localhost_33025_hdfs____.t48tvn/webapp 2023-07-17 13:10:53,002 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33025 2023-07-17 13:10:53,041 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-17 13:10:53,041 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-17 13:10:53,535 WARN [Listener at localhost/37401] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-17 13:10:53,673 WARN [Listener at localhost/37401] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-17 13:10:53,701 WARN [Listener at localhost/37401] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 13:10:53,707 INFO [Listener at localhost/37401] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 13:10:53,716 INFO [Listener at localhost/37401] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/java.io.tmpdir/Jetty_localhost_40051_datanode____.xin2h5/webapp 2023-07-17 13:10:53,837 INFO [Listener at localhost/37401] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40051 2023-07-17 13:10:54,431 WARN [Listener at localhost/34437] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-17 13:10:54,515 WARN [Listener at localhost/34437] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-17 13:10:54,522 WARN [Listener at localhost/34437] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 13:10:54,525 INFO [Listener at localhost/34437] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 13:10:54,543 INFO [Listener at localhost/34437] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/java.io.tmpdir/Jetty_localhost_39801_datanode____.wos22u/webapp 2023-07-17 13:10:54,675 INFO [Listener at localhost/34437] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39801 2023-07-17 13:10:54,697 WARN [Listener at localhost/42321] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-17 13:10:54,749 WARN [Listener at localhost/42321] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-17 13:10:54,753 WARN [Listener at localhost/42321] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 13:10:54,756 INFO [Listener at localhost/42321] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 13:10:54,778 INFO [Listener at localhost/42321] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/java.io.tmpdir/Jetty_localhost_34049_datanode____lxjk4b/webapp 2023-07-17 13:10:54,946 INFO [Listener at localhost/42321] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34049 2023-07-17 13:10:54,986 WARN [Listener at localhost/40321] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-17 13:10:55,265 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc715de09490ea487: Processing first storage report for DS-1a0e035c-fefd-4328-8b8b-91c14d64c5f5 from datanode a0d503ac-b6f9-4f20-ab6d-6e31c9966656 2023-07-17 13:10:55,268 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc715de09490ea487: from storage DS-1a0e035c-fefd-4328-8b8b-91c14d64c5f5 node DatanodeRegistration(127.0.0.1:35025, datanodeUuid=a0d503ac-b6f9-4f20-ab6d-6e31c9966656, infoPort=33397, infoSecurePort=0, ipcPort=34437, storageInfo=lv=-57;cid=testClusterID;nsid=1410241681;c=1689599452235), blocks: 0, hasStaleStorage: true, processing time: 3 msecs, invalidatedBlocks: 0 2023-07-17 13:10:55,268 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x802a3bcfca6f9200: Processing first storage report for DS-9c6c5b48-f0fb-4e41-b3f0-3247b1e8118c from datanode a4fc5897-d75b-479e-a243-9809aad1f7b0 2023-07-17 13:10:55,268 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x802a3bcfca6f9200: from storage DS-9c6c5b48-f0fb-4e41-b3f0-3247b1e8118c node DatanodeRegistration(127.0.0.1:43799, datanodeUuid=a4fc5897-d75b-479e-a243-9809aad1f7b0, infoPort=35985, infoSecurePort=0, ipcPort=40321, storageInfo=lv=-57;cid=testClusterID;nsid=1410241681;c=1689599452235), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-17 13:10:55,268 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbc325638ca5982e4: Processing first storage report for DS-f51d2073-91c1-48b7-aca7-a3c27435c01b from datanode 9c446925-9c0a-4db9-b083-b87fa8e611fb 2023-07-17 13:10:55,269 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbc325638ca5982e4: from storage DS-f51d2073-91c1-48b7-aca7-a3c27435c01b node DatanodeRegistration(127.0.0.1:37793, datanodeUuid=9c446925-9c0a-4db9-b083-b87fa8e611fb, infoPort=41099, infoSecurePort=0, ipcPort=42321, storageInfo=lv=-57;cid=testClusterID;nsid=1410241681;c=1689599452235), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-17 13:10:55,269 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc715de09490ea487: Processing first storage report for DS-6219d9ca-5cd3-44f5-a449-ab7b0967c9a7 from datanode a0d503ac-b6f9-4f20-ab6d-6e31c9966656 2023-07-17 13:10:55,269 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc715de09490ea487: from storage DS-6219d9ca-5cd3-44f5-a449-ab7b0967c9a7 node DatanodeRegistration(127.0.0.1:35025, datanodeUuid=a0d503ac-b6f9-4f20-ab6d-6e31c9966656, infoPort=33397, infoSecurePort=0, ipcPort=34437, storageInfo=lv=-57;cid=testClusterID;nsid=1410241681;c=1689599452235), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-17 13:10:55,269 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x802a3bcfca6f9200: Processing first storage report for DS-d2dea203-20ec-4d40-9044-2dea3915d542 from datanode a4fc5897-d75b-479e-a243-9809aad1f7b0 2023-07-17 13:10:55,269 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x802a3bcfca6f9200: from storage DS-d2dea203-20ec-4d40-9044-2dea3915d542 node DatanodeRegistration(127.0.0.1:43799, datanodeUuid=a4fc5897-d75b-479e-a243-9809aad1f7b0, infoPort=35985, infoSecurePort=0, ipcPort=40321, storageInfo=lv=-57;cid=testClusterID;nsid=1410241681;c=1689599452235), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-17 13:10:55,270 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbc325638ca5982e4: Processing first storage report for DS-78fe376a-d4b7-4ce5-bdd8-455b2f69b700 from datanode 9c446925-9c0a-4db9-b083-b87fa8e611fb 2023-07-17 13:10:55,270 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbc325638ca5982e4: from storage DS-78fe376a-d4b7-4ce5-bdd8-455b2f69b700 node DatanodeRegistration(127.0.0.1:37793, datanodeUuid=9c446925-9c0a-4db9-b083-b87fa8e611fb, infoPort=41099, infoSecurePort=0, ipcPort=42321, storageInfo=lv=-57;cid=testClusterID;nsid=1410241681;c=1689599452235), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-17 13:10:55,575 DEBUG [Listener at localhost/40321] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0 2023-07-17 13:10:55,693 INFO [Listener at localhost/40321] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/cluster_ebeb3e26-e5ee-6f23-45cc-cbe52345d6d9/zookeeper_0, clientPort=56233, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/cluster_ebeb3e26-e5ee-6f23-45cc-cbe52345d6d9/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/cluster_ebeb3e26-e5ee-6f23-45cc-cbe52345d6d9/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-17 13:10:55,720 INFO [Listener at localhost/40321] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=56233 2023-07-17 13:10:55,730 INFO [Listener at localhost/40321] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 13:10:55,733 INFO [Listener at localhost/40321] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 13:10:56,451 INFO [Listener at localhost/40321] util.FSUtils(471): Created version file at hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b with version=8 2023-07-17 13:10:56,451 INFO [Listener at localhost/40321] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/hbase-staging 2023-07-17 13:10:56,835 INFO [Listener at localhost/40321] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-17 13:10:57,418 INFO [Listener at localhost/40321] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-17 13:10:57,452 INFO [Listener at localhost/40321] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 13:10:57,453 INFO [Listener at localhost/40321] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-17 13:10:57,453 INFO [Listener at localhost/40321] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-17 13:10:57,453 INFO [Listener at localhost/40321] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 13:10:57,453 INFO [Listener at localhost/40321] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-17 13:10:57,626 INFO [Listener at localhost/40321] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-17 13:10:57,709 DEBUG [Listener at localhost/40321] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-17 13:10:57,835 INFO [Listener at localhost/40321] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44069 2023-07-17 13:10:57,852 INFO [Listener at localhost/40321] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 13:10:57,855 INFO [Listener at localhost/40321] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 13:10:57,884 INFO [Listener at localhost/40321] zookeeper.RecoverableZooKeeper(93): Process identifier=master:44069 connecting to ZooKeeper ensemble=127.0.0.1:56233 2023-07-17 13:10:57,945 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:440690x0, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-17 13:10:57,952 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:44069-0x101736834af0000 connected 2023-07-17 13:10:58,018 DEBUG [Listener at localhost/40321] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-17 13:10:58,019 DEBUG [Listener at localhost/40321] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 13:10:58,037 DEBUG [Listener at localhost/40321] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-17 13:10:58,046 DEBUG [Listener at localhost/40321] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44069 2023-07-17 13:10:58,046 DEBUG [Listener at localhost/40321] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44069 2023-07-17 13:10:58,047 DEBUG [Listener at localhost/40321] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44069 2023-07-17 13:10:58,049 DEBUG [Listener at localhost/40321] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44069 2023-07-17 13:10:58,050 DEBUG [Listener at localhost/40321] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44069 2023-07-17 13:10:58,057 INFO [Listener at localhost/40321] master.HMaster(444): hbase.rootdir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b, hbase.cluster.distributed=false 2023-07-17 13:10:58,131 INFO [Listener at localhost/40321] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-17 13:10:58,132 INFO [Listener at localhost/40321] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 13:10:58,132 INFO [Listener at localhost/40321] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-17 13:10:58,132 INFO [Listener at localhost/40321] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-17 13:10:58,132 INFO [Listener at localhost/40321] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 13:10:58,132 INFO [Listener at localhost/40321] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-17 13:10:58,139 INFO [Listener at localhost/40321] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-17 13:10:58,148 INFO [Listener at localhost/40321] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43575 2023-07-17 13:10:58,151 INFO [Listener at localhost/40321] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-17 13:10:58,159 DEBUG [Listener at localhost/40321] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-17 13:10:58,160 INFO [Listener at localhost/40321] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 13:10:58,162 INFO [Listener at localhost/40321] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 13:10:58,165 INFO [Listener at localhost/40321] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43575 connecting to ZooKeeper ensemble=127.0.0.1:56233 2023-07-17 13:10:58,171 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:435750x0, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-17 13:10:58,172 DEBUG [Listener at localhost/40321] zookeeper.ZKUtil(164): regionserver:435750x0, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-17 13:10:58,174 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43575-0x101736834af0001 connected 2023-07-17 13:10:58,175 DEBUG [Listener at localhost/40321] zookeeper.ZKUtil(164): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 13:10:58,177 DEBUG [Listener at localhost/40321] zookeeper.ZKUtil(164): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-17 13:10:58,178 DEBUG [Listener at localhost/40321] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43575 2023-07-17 13:10:58,178 DEBUG [Listener at localhost/40321] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43575 2023-07-17 13:10:58,180 DEBUG [Listener at localhost/40321] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43575 2023-07-17 13:10:58,180 DEBUG [Listener at localhost/40321] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43575 2023-07-17 13:10:58,181 DEBUG [Listener at localhost/40321] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43575 2023-07-17 13:10:58,200 INFO [Listener at localhost/40321] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-17 13:10:58,201 INFO [Listener at localhost/40321] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 13:10:58,201 INFO [Listener at localhost/40321] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-17 13:10:58,201 INFO [Listener at localhost/40321] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-17 13:10:58,202 INFO [Listener at localhost/40321] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 13:10:58,202 INFO [Listener at localhost/40321] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-17 13:10:58,202 INFO [Listener at localhost/40321] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-17 13:10:58,203 INFO [Listener at localhost/40321] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45883 2023-07-17 13:10:58,204 INFO [Listener at localhost/40321] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-17 13:10:58,206 DEBUG [Listener at localhost/40321] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-17 13:10:58,207 INFO [Listener at localhost/40321] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 13:10:58,210 INFO [Listener at localhost/40321] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 13:10:58,213 INFO [Listener at localhost/40321] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45883 connecting to ZooKeeper ensemble=127.0.0.1:56233 2023-07-17 13:10:58,226 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:458830x0, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-17 13:10:58,227 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45883-0x101736834af0002 connected 2023-07-17 13:10:58,227 DEBUG [Listener at localhost/40321] zookeeper.ZKUtil(164): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-17 13:10:58,228 DEBUG [Listener at localhost/40321] zookeeper.ZKUtil(164): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 13:10:58,230 DEBUG [Listener at localhost/40321] zookeeper.ZKUtil(164): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-17 13:10:58,230 DEBUG [Listener at localhost/40321] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45883 2023-07-17 13:10:58,234 DEBUG [Listener at localhost/40321] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45883 2023-07-17 13:10:58,235 DEBUG [Listener at localhost/40321] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45883 2023-07-17 13:10:58,256 DEBUG [Listener at localhost/40321] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45883 2023-07-17 13:10:58,257 DEBUG [Listener at localhost/40321] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45883 2023-07-17 13:10:58,270 INFO [Listener at localhost/40321] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-17 13:10:58,270 INFO [Listener at localhost/40321] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 13:10:58,271 INFO [Listener at localhost/40321] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-17 13:10:58,271 INFO [Listener at localhost/40321] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-17 13:10:58,271 INFO [Listener at localhost/40321] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 13:10:58,271 INFO [Listener at localhost/40321] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-17 13:10:58,271 INFO [Listener at localhost/40321] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-17 13:10:58,273 INFO [Listener at localhost/40321] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42601 2023-07-17 13:10:58,274 INFO [Listener at localhost/40321] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-17 13:10:58,279 DEBUG [Listener at localhost/40321] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-17 13:10:58,280 INFO [Listener at localhost/40321] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 13:10:58,282 INFO [Listener at localhost/40321] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 13:10:58,284 INFO [Listener at localhost/40321] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42601 connecting to ZooKeeper ensemble=127.0.0.1:56233 2023-07-17 13:10:58,290 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:426010x0, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-17 13:10:58,292 DEBUG [Listener at localhost/40321] zookeeper.ZKUtil(164): regionserver:426010x0, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-17 13:10:58,292 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:42601-0x101736834af0003 connected 2023-07-17 13:10:58,293 DEBUG [Listener at localhost/40321] zookeeper.ZKUtil(164): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 13:10:58,294 DEBUG [Listener at localhost/40321] zookeeper.ZKUtil(164): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-17 13:10:58,295 DEBUG [Listener at localhost/40321] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42601 2023-07-17 13:10:58,295 DEBUG [Listener at localhost/40321] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42601 2023-07-17 13:10:58,300 DEBUG [Listener at localhost/40321] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42601 2023-07-17 13:10:58,303 DEBUG [Listener at localhost/40321] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42601 2023-07-17 13:10:58,304 DEBUG [Listener at localhost/40321] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42601 2023-07-17 13:10:58,309 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,44069,1689599456641 2023-07-17 13:10:58,323 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-17 13:10:58,329 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,44069,1689599456641 2023-07-17 13:10:58,356 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-17 13:10:58,357 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-17 13:10:58,357 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 13:10:58,357 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-17 13:10:58,359 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-17 13:10:58,360 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-17 13:10:58,361 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-17 13:10:58,361 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,44069,1689599456641 from backup master directory 2023-07-17 13:10:58,368 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,44069,1689599456641 2023-07-17 13:10:58,368 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-17 13:10:58,369 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-17 13:10:58,369 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,44069,1689599456641 2023-07-17 13:10:58,374 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-17 13:10:58,379 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-17 13:10:58,520 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/hbase.id with ID: 0f3775d5-e27b-4bf8-828f-ff80aa844087 2023-07-17 13:10:58,571 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 13:10:58,594 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 13:10:58,675 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x49e62556 to 127.0.0.1:56233 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:10:58,725 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f9ce594, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:10:58,755 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-17 13:10:58,757 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-17 13:10:58,777 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-17 13:10:58,777 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-17 13:10:58,779 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-17 13:10:58,785 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-17 13:10:58,786 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-17 13:10:58,824 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/MasterData/data/master/store-tmp 2023-07-17 13:10:58,867 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:10:58,867 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-17 13:10:58,867 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 13:10:58,867 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 13:10:58,867 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-17 13:10:58,867 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 13:10:58,868 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 13:10:58,868 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-17 13:10:58,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/MasterData/WALs/jenkins-hbase4.apache.org,44069,1689599456641 2023-07-17 13:10:58,914 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44069%2C1689599456641, suffix=, logDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/MasterData/WALs/jenkins-hbase4.apache.org,44069,1689599456641, archiveDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/MasterData/oldWALs, maxLogs=10 2023-07-17 13:10:58,995 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37793,DS-f51d2073-91c1-48b7-aca7-a3c27435c01b,DISK] 2023-07-17 13:10:58,995 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35025,DS-1a0e035c-fefd-4328-8b8b-91c14d64c5f5,DISK] 2023-07-17 13:10:58,995 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43799,DS-9c6c5b48-f0fb-4e41-b3f0-3247b1e8118c,DISK] 2023-07-17 13:10:59,008 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-17 13:10:59,090 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/MasterData/WALs/jenkins-hbase4.apache.org,44069,1689599456641/jenkins-hbase4.apache.org%2C44069%2C1689599456641.1689599458927 2023-07-17 13:10:59,091 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35025,DS-1a0e035c-fefd-4328-8b8b-91c14d64c5f5,DISK], DatanodeInfoWithStorage[127.0.0.1:37793,DS-f51d2073-91c1-48b7-aca7-a3c27435c01b,DISK], DatanodeInfoWithStorage[127.0.0.1:43799,DS-9c6c5b48-f0fb-4e41-b3f0-3247b1e8118c,DISK]] 2023-07-17 13:10:59,092 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-17 13:10:59,093 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:10:59,097 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-17 13:10:59,098 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-17 13:10:59,170 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-17 13:10:59,178 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-17 13:10:59,206 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-17 13:10:59,218 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:10:59,224 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-17 13:10:59,226 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-17 13:10:59,247 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-17 13:10:59,254 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 13:10:59,255 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62301360, jitterRate=-0.07163739204406738}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 13:10:59,255 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-17 13:10:59,259 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-17 13:10:59,282 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-17 13:10:59,282 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-17 13:10:59,285 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-17 13:10:59,287 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-17 13:10:59,332 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 44 msec 2023-07-17 13:10:59,332 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-17 13:10:59,363 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-17 13:10:59,369 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-17 13:10:59,401 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-17 13:10:59,408 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-17 13:10:59,410 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-17 13:10:59,418 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-17 13:10:59,424 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-17 13:10:59,428 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 13:10:59,432 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-17 13:10:59,434 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-17 13:10:59,464 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-17 13:10:59,471 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-17 13:10:59,471 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-17 13:10:59,471 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-17 13:10:59,471 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-17 13:10:59,471 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 13:10:59,475 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,44069,1689599456641, sessionid=0x101736834af0000, setting cluster-up flag (Was=false) 2023-07-17 13:10:59,503 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 13:10:59,514 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-17 13:10:59,516 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44069,1689599456641 2023-07-17 13:10:59,524 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 13:10:59,534 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-17 13:10:59,539 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44069,1689599456641 2023-07-17 13:10:59,542 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp 2023-07-17 13:10:59,613 INFO [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(951): ClusterId : 0f3775d5-e27b-4bf8-828f-ff80aa844087 2023-07-17 13:10:59,627 INFO [RS:2;jenkins-hbase4:42601] regionserver.HRegionServer(951): ClusterId : 0f3775d5-e27b-4bf8-828f-ff80aa844087 2023-07-17 13:10:59,629 INFO [RS:1;jenkins-hbase4:45883] regionserver.HRegionServer(951): ClusterId : 0f3775d5-e27b-4bf8-828f-ff80aa844087 2023-07-17 13:10:59,635 DEBUG [RS:1;jenkins-hbase4:45883] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-17 13:10:59,635 DEBUG [RS:0;jenkins-hbase4:43575] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-17 13:10:59,638 DEBUG [RS:2;jenkins-hbase4:42601] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-17 13:10:59,643 DEBUG [RS:1;jenkins-hbase4:45883] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-17 13:10:59,643 DEBUG [RS:1;jenkins-hbase4:45883] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-17 13:10:59,643 DEBUG [RS:2;jenkins-hbase4:42601] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-17 13:10:59,643 DEBUG [RS:2;jenkins-hbase4:42601] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-17 13:10:59,647 DEBUG [RS:0;jenkins-hbase4:43575] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-17 13:10:59,647 DEBUG [RS:0;jenkins-hbase4:43575] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-17 13:10:59,648 DEBUG [RS:2;jenkins-hbase4:42601] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-17 13:10:59,650 DEBUG [RS:1;jenkins-hbase4:45883] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-17 13:10:59,651 DEBUG [RS:1;jenkins-hbase4:45883] zookeeper.ReadOnlyZKClient(139): Connect 0x01fd1575 to 127.0.0.1:56233 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:10:59,651 DEBUG [RS:2;jenkins-hbase4:42601] zookeeper.ReadOnlyZKClient(139): Connect 0x646d20c6 to 127.0.0.1:56233 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:10:59,653 DEBUG [RS:0;jenkins-hbase4:43575] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-17 13:10:59,681 DEBUG [RS:0;jenkins-hbase4:43575] zookeeper.ReadOnlyZKClient(139): Connect 0x310dc82a to 127.0.0.1:56233 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:10:59,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-17 13:10:59,748 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 13:10:59,749 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-17 13:10:59,739 DEBUG [RS:1;jenkins-hbase4:45883] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f3aeb3a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:10:59,760 DEBUG [RS:1;jenkins-hbase4:45883] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b057e05, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-17 13:10:59,760 DEBUG [RS:2;jenkins-hbase4:42601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6aaac23b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:10:59,761 DEBUG [RS:2;jenkins-hbase4:42601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e954bb6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-17 13:10:59,771 DEBUG [RS:0;jenkins-hbase4:43575] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3fca307b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:10:59,772 DEBUG [RS:0;jenkins-hbase4:43575] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ef73a40, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-17 13:10:59,792 DEBUG [RS:2;jenkins-hbase4:42601] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:42601 2023-07-17 13:10:59,795 DEBUG [RS:0;jenkins-hbase4:43575] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:43575 2023-07-17 13:10:59,796 DEBUG [RS:1;jenkins-hbase4:45883] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:45883 2023-07-17 13:10:59,800 INFO [RS:0;jenkins-hbase4:43575] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-17 13:10:59,801 INFO [RS:0;jenkins-hbase4:43575] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-17 13:10:59,801 INFO [RS:2;jenkins-hbase4:42601] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-17 13:10:59,801 INFO [RS:2;jenkins-hbase4:42601] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-17 13:10:59,800 INFO [RS:1;jenkins-hbase4:45883] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-17 13:10:59,802 INFO [RS:1;jenkins-hbase4:45883] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-17 13:10:59,802 DEBUG [RS:2;jenkins-hbase4:42601] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-17 13:10:59,802 DEBUG [RS:1;jenkins-hbase4:45883] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-17 13:10:59,803 INFO [RS:2;jenkins-hbase4:42601] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 13:10:59,804 DEBUG [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-17 13:10:59,804 INFO [RS:1;jenkins-hbase4:45883] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 13:10:59,804 DEBUG [RS:1;jenkins-hbase4:45883] regionserver.HRegionServer(1022): About to register with Master. 2023-07-17 13:10:59,804 INFO [RS:0;jenkins-hbase4:43575] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 13:10:59,804 DEBUG [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(1022): About to register with Master. 2023-07-17 13:10:59,804 DEBUG [RS:2;jenkins-hbase4:42601] regionserver.HRegionServer(1022): About to register with Master. 2023-07-17 13:10:59,807 INFO [RS:1;jenkins-hbase4:45883] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44069,1689599456641 with isa=jenkins-hbase4.apache.org/172.31.14.131:45883, startcode=1689599458200 2023-07-17 13:10:59,807 INFO [RS:2;jenkins-hbase4:42601] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44069,1689599456641 with isa=jenkins-hbase4.apache.org/172.31.14.131:42601, startcode=1689599458269 2023-07-17 13:10:59,810 INFO [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44069,1689599456641 with isa=jenkins-hbase4.apache.org/172.31.14.131:43575, startcode=1689599458131 2023-07-17 13:10:59,836 DEBUG [RS:2;jenkins-hbase4:42601] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-17 13:10:59,836 DEBUG [RS:1;jenkins-hbase4:45883] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-17 13:10:59,846 DEBUG [RS:0;jenkins-hbase4:43575] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-17 13:10:59,895 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-17 13:10:59,916 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-17 13:10:59,917 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-17 13:10:59,917 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-17 13:10:59,917 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-17 13:10:59,917 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-17 13:10:59,917 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:10:59,918 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-17 13:10:59,918 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:10:59,930 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38935, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-17 13:10:59,930 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36343, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-17 13:10:59,930 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46849, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-17 13:10:59,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689599489935 2023-07-17 13:10:59,938 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-17 13:10:59,943 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44069] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-17 13:10:59,953 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44069] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-17 13:10:59,969 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44069] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-17 13:10:59,978 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-17 13:10:59,981 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-17 13:10:59,982 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-17 13:10:59,986 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-17 13:10:59,986 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-17 13:10:59,987 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-17 13:10:59,987 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-17 13:10:59,988 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-17 13:10:59,988 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-17 13:10:59,989 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-17 13:10:59,990 DEBUG [RS:1;jenkins-hbase4:45883] regionserver.HRegionServer(2830): Master is not running yet 2023-07-17 13:10:59,990 DEBUG [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(2830): Master is not running yet 2023-07-17 13:10:59,991 WARN [RS:1;jenkins-hbase4:45883] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-17 13:10:59,990 DEBUG [RS:2;jenkins-hbase4:42601] regionserver.HRegionServer(2830): Master is not running yet 2023-07-17 13:10:59,991 WARN [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-17 13:10:59,991 WARN [RS:2;jenkins-hbase4:42601] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-17 13:10:59,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-17 13:10:59,994 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-17 13:10:59,999 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-17 13:10:59,999 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-17 13:11:00,004 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689599460002,5,FailOnTimeoutGroup] 2023-07-17 13:11:00,015 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689599460004,5,FailOnTimeoutGroup] 2023-07-17 13:11:00,015 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:00,015 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-17 13:11:00,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:00,019 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:00,052 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-17 13:11:00,053 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-17 13:11:00,054 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b 2023-07-17 13:11:00,093 INFO [RS:1;jenkins-hbase4:45883] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44069,1689599456641 with isa=jenkins-hbase4.apache.org/172.31.14.131:45883, startcode=1689599458200 2023-07-17 13:11:00,093 INFO [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44069,1689599456641 with isa=jenkins-hbase4.apache.org/172.31.14.131:43575, startcode=1689599458131 2023-07-17 13:11:00,093 INFO [RS:2;jenkins-hbase4:42601] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44069,1689599456641 with isa=jenkins-hbase4.apache.org/172.31.14.131:42601, startcode=1689599458269 2023-07-17 13:11:00,115 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44069] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:00,122 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44069] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:00,123 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44069] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:00,126 DEBUG [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b 2023-07-17 13:11:00,126 DEBUG [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:37401 2023-07-17 13:11:00,126 DEBUG [RS:2;jenkins-hbase4:42601] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b 2023-07-17 13:11:00,126 DEBUG [RS:2;jenkins-hbase4:42601] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:37401 2023-07-17 13:11:00,126 DEBUG [RS:1;jenkins-hbase4:45883] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b 2023-07-17 13:11:00,127 DEBUG [RS:1;jenkins-hbase4:45883] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:37401 2023-07-17 13:11:00,127 DEBUG [RS:1;jenkins-hbase4:45883] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-17 13:11:00,126 DEBUG [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-17 13:11:00,126 DEBUG [RS:2;jenkins-hbase4:42601] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-17 13:11:00,136 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 13:11:00,143 WARN [DataStreamer for file /user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/meta/1588230740/.regioninfo] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-17 13:11:00,144 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:11:00,145 DEBUG [RS:1;jenkins-hbase4:45883] zookeeper.ZKUtil(162): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:00,145 WARN [RS:1;jenkins-hbase4:45883] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-17 13:11:00,147 INFO [RS:1;jenkins-hbase4:45883] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-17 13:11:00,147 DEBUG [RS:1;jenkins-hbase4:45883] regionserver.HRegionServer(1948): logDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/WALs/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:00,148 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42601,1689599458269] 2023-07-17 13:11:00,148 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45883,1689599458200] 2023-07-17 13:11:00,148 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43575,1689599458131] 2023-07-17 13:11:00,148 DEBUG [RS:0;jenkins-hbase4:43575] zookeeper.ZKUtil(162): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:00,148 WARN [RS:0;jenkins-hbase4:43575] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-17 13:11:00,150 INFO [RS:0;jenkins-hbase4:43575] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-17 13:11:00,151 DEBUG [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(1948): logDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/WALs/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:00,152 DEBUG [RS:2;jenkins-hbase4:42601] zookeeper.ZKUtil(162): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:00,152 WARN [RS:2;jenkins-hbase4:42601] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-17 13:11:00,153 INFO [RS:2;jenkins-hbase4:42601] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-17 13:11:00,153 DEBUG [RS:2;jenkins-hbase4:42601] regionserver.HRegionServer(1948): logDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/WALs/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:00,154 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-17 13:11:00,161 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/meta/1588230740/info 2023-07-17 13:11:00,161 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-17 13:11:00,162 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:11:00,163 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-17 13:11:00,165 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/meta/1588230740/rep_barrier 2023-07-17 13:11:00,166 DEBUG [RS:0;jenkins-hbase4:43575] zookeeper.ZKUtil(162): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:00,166 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-17 13:11:00,166 DEBUG [RS:1;jenkins-hbase4:45883] zookeeper.ZKUtil(162): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:00,166 DEBUG [RS:2;jenkins-hbase4:42601] zookeeper.ZKUtil(162): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:00,167 DEBUG [RS:0;jenkins-hbase4:43575] zookeeper.ZKUtil(162): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:00,168 DEBUG [RS:1;jenkins-hbase4:45883] zookeeper.ZKUtil(162): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:00,168 DEBUG [RS:2;jenkins-hbase4:42601] zookeeper.ZKUtil(162): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:00,169 DEBUG [RS:0;jenkins-hbase4:43575] zookeeper.ZKUtil(162): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:00,169 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:11:00,169 DEBUG [RS:1;jenkins-hbase4:45883] zookeeper.ZKUtil(162): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:00,169 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-17 13:11:00,170 DEBUG [RS:2;jenkins-hbase4:42601] zookeeper.ZKUtil(162): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:00,172 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/meta/1588230740/table 2023-07-17 13:11:00,179 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-17 13:11:00,180 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:11:00,184 DEBUG [RS:2;jenkins-hbase4:42601] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-17 13:11:00,184 DEBUG [RS:1;jenkins-hbase4:45883] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-17 13:11:00,185 DEBUG [RS:0;jenkins-hbase4:43575] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-17 13:11:00,184 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/meta/1588230740 2023-07-17 13:11:00,188 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/meta/1588230740 2023-07-17 13:11:00,192 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-17 13:11:00,195 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-17 13:11:00,199 INFO [RS:1;jenkins-hbase4:45883] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-17 13:11:00,199 INFO [RS:0;jenkins-hbase4:43575] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-17 13:11:00,199 INFO [RS:2;jenkins-hbase4:42601] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-17 13:11:00,243 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 13:11:00,246 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70210371, jitterRate=0.04621605575084686}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-17 13:11:00,246 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-17 13:11:00,246 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-17 13:11:00,246 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-17 13:11:00,246 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-17 13:11:00,246 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-17 13:11:00,246 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-17 13:11:00,253 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-17 13:11:00,253 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-17 13:11:00,261 INFO [RS:2;jenkins-hbase4:42601] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-17 13:11:00,262 INFO [RS:1;jenkins-hbase4:45883] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-17 13:11:00,277 INFO [RS:0;jenkins-hbase4:43575] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-17 13:11:00,277 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-17 13:11:00,277 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-17 13:11:00,278 INFO [RS:2;jenkins-hbase4:42601] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-17 13:11:00,278 INFO [RS:2;jenkins-hbase4:42601] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:00,278 INFO [RS:1;jenkins-hbase4:45883] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-17 13:11:00,279 INFO [RS:0;jenkins-hbase4:43575] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-17 13:11:00,279 INFO [RS:1;jenkins-hbase4:45883] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:00,282 INFO [RS:2;jenkins-hbase4:42601] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-17 13:11:00,280 INFO [RS:0;jenkins-hbase4:43575] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:00,293 INFO [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-17 13:11:00,293 INFO [RS:1;jenkins-hbase4:45883] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-17 13:11:00,301 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-17 13:11:00,306 INFO [RS:2;jenkins-hbase4:42601] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:00,306 INFO [RS:1;jenkins-hbase4:45883] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:00,306 DEBUG [RS:2;jenkins-hbase4:42601] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,307 DEBUG [RS:2;jenkins-hbase4:42601] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,307 DEBUG [RS:2;jenkins-hbase4:42601] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,307 DEBUG [RS:2;jenkins-hbase4:42601] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,313 INFO [RS:0;jenkins-hbase4:43575] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:00,313 DEBUG [RS:2;jenkins-hbase4:42601] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,306 DEBUG [RS:1;jenkins-hbase4:45883] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,316 DEBUG [RS:0;jenkins-hbase4:43575] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,316 DEBUG [RS:1;jenkins-hbase4:45883] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,316 DEBUG [RS:0;jenkins-hbase4:43575] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,316 DEBUG [RS:1;jenkins-hbase4:45883] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,316 DEBUG [RS:0;jenkins-hbase4:43575] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,316 DEBUG [RS:1;jenkins-hbase4:45883] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,316 DEBUG [RS:0;jenkins-hbase4:43575] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,316 DEBUG [RS:1;jenkins-hbase4:45883] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,316 DEBUG [RS:0;jenkins-hbase4:43575] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,316 DEBUG [RS:1;jenkins-hbase4:45883] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-17 13:11:00,316 DEBUG [RS:0;jenkins-hbase4:43575] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-17 13:11:00,317 DEBUG [RS:1;jenkins-hbase4:45883] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,317 DEBUG [RS:0;jenkins-hbase4:43575] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,317 DEBUG [RS:1;jenkins-hbase4:45883] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,317 DEBUG [RS:0;jenkins-hbase4:43575] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,317 DEBUG [RS:1;jenkins-hbase4:45883] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,317 DEBUG [RS:0;jenkins-hbase4:43575] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,317 DEBUG [RS:1;jenkins-hbase4:45883] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,317 DEBUG [RS:0;jenkins-hbase4:43575] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,317 DEBUG [RS:2;jenkins-hbase4:42601] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-17 13:11:00,317 DEBUG [RS:2;jenkins-hbase4:42601] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,318 DEBUG [RS:2;jenkins-hbase4:42601] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,318 DEBUG [RS:2;jenkins-hbase4:42601] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,318 DEBUG [RS:2;jenkins-hbase4:42601] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,353 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-17 13:11:00,354 INFO [RS:2;jenkins-hbase4:42601] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:00,354 INFO [RS:2;jenkins-hbase4:42601] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:00,354 INFO [RS:1;jenkins-hbase4:45883] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:00,355 INFO [RS:2;jenkins-hbase4:42601] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:00,354 INFO [RS:0;jenkins-hbase4:43575] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:00,355 INFO [RS:1;jenkins-hbase4:45883] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:00,355 INFO [RS:0;jenkins-hbase4:43575] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:00,356 INFO [RS:0;jenkins-hbase4:43575] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:00,355 INFO [RS:1;jenkins-hbase4:45883] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:00,358 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-17 13:11:00,379 INFO [RS:0;jenkins-hbase4:43575] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-17 13:11:00,379 INFO [RS:2;jenkins-hbase4:42601] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-17 13:11:00,380 INFO [RS:1;jenkins-hbase4:45883] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-17 13:11:00,384 INFO [RS:0;jenkins-hbase4:43575] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43575,1689599458131-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:00,384 INFO [RS:2;jenkins-hbase4:42601] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42601,1689599458269-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:00,384 INFO [RS:1;jenkins-hbase4:45883] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45883,1689599458200-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:00,415 INFO [RS:0;jenkins-hbase4:43575] regionserver.Replication(203): jenkins-hbase4.apache.org,43575,1689599458131 started 2023-07-17 13:11:00,415 INFO [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,43575,1689599458131, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43575, sessionid=0x101736834af0001 2023-07-17 13:11:00,415 INFO [RS:2;jenkins-hbase4:42601] regionserver.Replication(203): jenkins-hbase4.apache.org,42601,1689599458269 started 2023-07-17 13:11:00,415 INFO [RS:2;jenkins-hbase4:42601] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,42601,1689599458269, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42601, sessionid=0x101736834af0003 2023-07-17 13:11:00,418 INFO [RS:1;jenkins-hbase4:45883] regionserver.Replication(203): jenkins-hbase4.apache.org,45883,1689599458200 started 2023-07-17 13:11:00,418 DEBUG [RS:0;jenkins-hbase4:43575] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-17 13:11:00,418 INFO [RS:1;jenkins-hbase4:45883] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,45883,1689599458200, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45883, sessionid=0x101736834af0002 2023-07-17 13:11:00,419 DEBUG [RS:1;jenkins-hbase4:45883] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-17 13:11:00,418 DEBUG [RS:2;jenkins-hbase4:42601] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-17 13:11:00,419 DEBUG [RS:1;jenkins-hbase4:45883] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:00,419 DEBUG [RS:0;jenkins-hbase4:43575] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:00,423 DEBUG [RS:1;jenkins-hbase4:45883] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45883,1689599458200' 2023-07-17 13:11:00,423 DEBUG [RS:0;jenkins-hbase4:43575] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43575,1689599458131' 2023-07-17 13:11:00,423 DEBUG [RS:0;jenkins-hbase4:43575] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-17 13:11:00,422 DEBUG [RS:2;jenkins-hbase4:42601] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:00,424 DEBUG [RS:2;jenkins-hbase4:42601] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42601,1689599458269' 2023-07-17 13:11:00,424 DEBUG [RS:2;jenkins-hbase4:42601] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-17 13:11:00,425 DEBUG [RS:2;jenkins-hbase4:42601] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-17 13:11:00,425 DEBUG [RS:0;jenkins-hbase4:43575] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-17 13:11:00,423 DEBUG [RS:1;jenkins-hbase4:45883] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-17 13:11:00,425 DEBUG [RS:2;jenkins-hbase4:42601] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-17 13:11:00,426 DEBUG [RS:2;jenkins-hbase4:42601] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-17 13:11:00,426 DEBUG [RS:1;jenkins-hbase4:45883] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-17 13:11:00,426 DEBUG [RS:0;jenkins-hbase4:43575] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-17 13:11:00,426 DEBUG [RS:2;jenkins-hbase4:42601] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:00,426 DEBUG [RS:0;jenkins-hbase4:43575] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-17 13:11:00,426 DEBUG [RS:2;jenkins-hbase4:42601] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42601,1689599458269' 2023-07-17 13:11:00,427 DEBUG [RS:1;jenkins-hbase4:45883] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-17 13:11:00,427 DEBUG [RS:2;jenkins-hbase4:42601] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:00,426 DEBUG [RS:0;jenkins-hbase4:43575] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:00,427 DEBUG [RS:1;jenkins-hbase4:45883] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-17 13:11:00,427 DEBUG [RS:1;jenkins-hbase4:45883] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:00,427 DEBUG [RS:0;jenkins-hbase4:43575] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43575,1689599458131' 2023-07-17 13:11:00,427 DEBUG [RS:0;jenkins-hbase4:43575] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:00,427 DEBUG [RS:1;jenkins-hbase4:45883] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45883,1689599458200' 2023-07-17 13:11:00,427 DEBUG [RS:2;jenkins-hbase4:42601] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:00,427 DEBUG [RS:1;jenkins-hbase4:45883] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:00,428 DEBUG [RS:0;jenkins-hbase4:43575] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:00,428 DEBUG [RS:1;jenkins-hbase4:45883] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:00,428 DEBUG [RS:2;jenkins-hbase4:42601] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-17 13:11:00,428 DEBUG [RS:0;jenkins-hbase4:43575] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-17 13:11:00,428 INFO [RS:2;jenkins-hbase4:42601] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-17 13:11:00,429 INFO [RS:0;jenkins-hbase4:43575] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-17 13:11:00,429 DEBUG [RS:1;jenkins-hbase4:45883] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-17 13:11:00,430 INFO [RS:1;jenkins-hbase4:45883] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-17 13:11:00,430 INFO [RS:1;jenkins-hbase4:45883] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-17 13:11:00,429 INFO [RS:0;jenkins-hbase4:43575] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-17 13:11:00,429 INFO [RS:2;jenkins-hbase4:42601] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-17 13:11:00,511 DEBUG [jenkins-hbase4:44069] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-17 13:11:00,517 DEBUG [jenkins-hbase4:44069] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 13:11:00,525 DEBUG [jenkins-hbase4:44069] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 13:11:00,525 DEBUG [jenkins-hbase4:44069] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 13:11:00,525 DEBUG [jenkins-hbase4:44069] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 13:11:00,525 DEBUG [jenkins-hbase4:44069] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 13:11:00,529 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42601,1689599458269, state=OPENING 2023-07-17 13:11:00,541 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-17 13:11:00,542 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 13:11:00,543 INFO [RS:2;jenkins-hbase4:42601] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42601%2C1689599458269, suffix=, logDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/WALs/jenkins-hbase4.apache.org,42601,1689599458269, archiveDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/oldWALs, maxLogs=32 2023-07-17 13:11:00,547 INFO [RS:1;jenkins-hbase4:45883] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45883%2C1689599458200, suffix=, logDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/WALs/jenkins-hbase4.apache.org,45883,1689599458200, archiveDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/oldWALs, maxLogs=32 2023-07-17 13:11:00,548 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-17 13:11:00,548 INFO [RS:0;jenkins-hbase4:43575] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43575%2C1689599458131, suffix=, logDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/WALs/jenkins-hbase4.apache.org,43575,1689599458131, archiveDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/oldWALs, maxLogs=32 2023-07-17 13:11:00,549 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42601,1689599458269}] 2023-07-17 13:11:00,608 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43799,DS-9c6c5b48-f0fb-4e41-b3f0-3247b1e8118c,DISK] 2023-07-17 13:11:00,608 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37793,DS-f51d2073-91c1-48b7-aca7-a3c27435c01b,DISK] 2023-07-17 13:11:00,609 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35025,DS-1a0e035c-fefd-4328-8b8b-91c14d64c5f5,DISK] 2023-07-17 13:11:00,626 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43799,DS-9c6c5b48-f0fb-4e41-b3f0-3247b1e8118c,DISK] 2023-07-17 13:11:00,627 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37793,DS-f51d2073-91c1-48b7-aca7-a3c27435c01b,DISK] 2023-07-17 13:11:00,627 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35025,DS-1a0e035c-fefd-4328-8b8b-91c14d64c5f5,DISK] 2023-07-17 13:11:00,643 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43799,DS-9c6c5b48-f0fb-4e41-b3f0-3247b1e8118c,DISK] 2023-07-17 13:11:00,649 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35025,DS-1a0e035c-fefd-4328-8b8b-91c14d64c5f5,DISK] 2023-07-17 13:11:00,650 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37793,DS-f51d2073-91c1-48b7-aca7-a3c27435c01b,DISK] 2023-07-17 13:11:00,657 INFO [RS:0;jenkins-hbase4:43575] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/WALs/jenkins-hbase4.apache.org,43575,1689599458131/jenkins-hbase4.apache.org%2C43575%2C1689599458131.1689599460565 2023-07-17 13:11:00,658 DEBUG [RS:0;jenkins-hbase4:43575] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43799,DS-9c6c5b48-f0fb-4e41-b3f0-3247b1e8118c,DISK], DatanodeInfoWithStorage[127.0.0.1:35025,DS-1a0e035c-fefd-4328-8b8b-91c14d64c5f5,DISK], DatanodeInfoWithStorage[127.0.0.1:37793,DS-f51d2073-91c1-48b7-aca7-a3c27435c01b,DISK]] 2023-07-17 13:11:00,658 INFO [RS:2;jenkins-hbase4:42601] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/WALs/jenkins-hbase4.apache.org,42601,1689599458269/jenkins-hbase4.apache.org%2C42601%2C1689599458269.1689599460564 2023-07-17 13:11:00,672 INFO [RS:1;jenkins-hbase4:45883] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/WALs/jenkins-hbase4.apache.org,45883,1689599458200/jenkins-hbase4.apache.org%2C45883%2C1689599458200.1689599460565 2023-07-17 13:11:00,672 DEBUG [RS:2;jenkins-hbase4:42601] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43799,DS-9c6c5b48-f0fb-4e41-b3f0-3247b1e8118c,DISK], DatanodeInfoWithStorage[127.0.0.1:35025,DS-1a0e035c-fefd-4328-8b8b-91c14d64c5f5,DISK], DatanodeInfoWithStorage[127.0.0.1:37793,DS-f51d2073-91c1-48b7-aca7-a3c27435c01b,DISK]] 2023-07-17 13:11:00,675 DEBUG [RS:1;jenkins-hbase4:45883] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35025,DS-1a0e035c-fefd-4328-8b8b-91c14d64c5f5,DISK], DatanodeInfoWithStorage[127.0.0.1:37793,DS-f51d2073-91c1-48b7-aca7-a3c27435c01b,DISK], DatanodeInfoWithStorage[127.0.0.1:43799,DS-9c6c5b48-f0fb-4e41-b3f0-3247b1e8118c,DISK]] 2023-07-17 13:11:00,753 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:00,756 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-17 13:11:00,760 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34158, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-17 13:11:00,777 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-17 13:11:00,778 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-17 13:11:00,783 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42601%2C1689599458269.meta, suffix=.meta, logDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/WALs/jenkins-hbase4.apache.org,42601,1689599458269, archiveDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/oldWALs, maxLogs=32 2023-07-17 13:11:00,808 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37793,DS-f51d2073-91c1-48b7-aca7-a3c27435c01b,DISK] 2023-07-17 13:11:00,809 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43799,DS-9c6c5b48-f0fb-4e41-b3f0-3247b1e8118c,DISK] 2023-07-17 13:11:00,816 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35025,DS-1a0e035c-fefd-4328-8b8b-91c14d64c5f5,DISK] 2023-07-17 13:11:00,832 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/WALs/jenkins-hbase4.apache.org,42601,1689599458269/jenkins-hbase4.apache.org%2C42601%2C1689599458269.meta.1689599460784.meta 2023-07-17 13:11:00,833 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37793,DS-f51d2073-91c1-48b7-aca7-a3c27435c01b,DISK], DatanodeInfoWithStorage[127.0.0.1:43799,DS-9c6c5b48-f0fb-4e41-b3f0-3247b1e8118c,DISK], DatanodeInfoWithStorage[127.0.0.1:35025,DS-1a0e035c-fefd-4328-8b8b-91c14d64c5f5,DISK]] 2023-07-17 13:11:00,833 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-17 13:11:00,835 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-17 13:11:00,837 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 13:11:00,838 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-17 13:11:00,841 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-17 13:11:00,843 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-17 13:11:00,858 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-17 13:11:00,858 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:11:00,858 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-17 13:11:00,858 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-17 13:11:00,862 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-17 13:11:00,866 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/meta/1588230740/info 2023-07-17 13:11:00,866 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/meta/1588230740/info 2023-07-17 13:11:00,867 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-17 13:11:00,868 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:11:00,868 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-17 13:11:00,870 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/meta/1588230740/rep_barrier 2023-07-17 13:11:00,870 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/meta/1588230740/rep_barrier 2023-07-17 13:11:00,871 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-17 13:11:00,873 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:11:00,873 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-17 13:11:00,875 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/meta/1588230740/table 2023-07-17 13:11:00,875 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/meta/1588230740/table 2023-07-17 13:11:00,876 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-17 13:11:00,877 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:11:00,879 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/meta/1588230740 2023-07-17 13:11:00,886 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/meta/1588230740 2023-07-17 13:11:00,890 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-17 13:11:00,893 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-17 13:11:00,895 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70080220, jitterRate=0.044276654720306396}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-17 13:11:00,898 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-17 13:11:00,918 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689599460745 2023-07-17 13:11:00,940 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-17 13:11:00,941 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-17 13:11:00,942 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42601,1689599458269, state=OPEN 2023-07-17 13:11:00,945 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-17 13:11:00,946 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-17 13:11:00,957 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-17 13:11:00,958 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42601,1689599458269 in 397 msec 2023-07-17 13:11:00,966 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-17 13:11:00,966 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 659 msec 2023-07-17 13:11:01,023 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.2430 sec 2023-07-17 13:11:01,024 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689599461024, completionTime=-1 2023-07-17 13:11:01,024 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-17 13:11:01,024 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-17 13:11:01,108 DEBUG [hconnection-0x12d0e02b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:01,112 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34164, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:11:01,141 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-17 13:11:01,141 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689599521141 2023-07-17 13:11:01,141 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689599581141 2023-07-17 13:11:01,141 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 116 msec 2023-07-17 13:11:01,172 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44069,1689599456641-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:01,172 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44069,1689599456641-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:01,172 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44069,1689599456641-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:01,176 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:44069, period=300000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:01,177 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:01,185 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-17 13:11:01,200 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-17 13:11:01,202 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-17 13:11:01,216 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-17 13:11:01,220 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 13:11:01,226 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 13:11:01,253 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/hbase/namespace/d5e24905ea8c385abbebf6a0b4d28aba 2023-07-17 13:11:01,260 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/hbase/namespace/d5e24905ea8c385abbebf6a0b4d28aba empty. 2023-07-17 13:11:01,262 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/hbase/namespace/d5e24905ea8c385abbebf6a0b4d28aba 2023-07-17 13:11:01,262 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-17 13:11:01,318 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-17 13:11:01,321 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => d5e24905ea8c385abbebf6a0b4d28aba, NAME => 'hbase:namespace,,1689599461201.d5e24905ea8c385abbebf6a0b4d28aba.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp 2023-07-17 13:11:01,360 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689599461201.d5e24905ea8c385abbebf6a0b4d28aba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:11:01,361 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing d5e24905ea8c385abbebf6a0b4d28aba, disabling compactions & flushes 2023-07-17 13:11:01,361 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689599461201.d5e24905ea8c385abbebf6a0b4d28aba. 2023-07-17 13:11:01,361 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689599461201.d5e24905ea8c385abbebf6a0b4d28aba. 2023-07-17 13:11:01,361 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689599461201.d5e24905ea8c385abbebf6a0b4d28aba. after waiting 0 ms 2023-07-17 13:11:01,361 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689599461201.d5e24905ea8c385abbebf6a0b4d28aba. 2023-07-17 13:11:01,361 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689599461201.d5e24905ea8c385abbebf6a0b4d28aba. 2023-07-17 13:11:01,361 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for d5e24905ea8c385abbebf6a0b4d28aba: 2023-07-17 13:11:01,366 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 13:11:01,382 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689599461201.d5e24905ea8c385abbebf6a0b4d28aba.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689599461369"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599461369"}]},"ts":"1689599461369"} 2023-07-17 13:11:01,413 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-17 13:11:01,415 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 13:11:01,419 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599461415"}]},"ts":"1689599461415"} 2023-07-17 13:11:01,424 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-17 13:11:01,442 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 13:11:01,443 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 13:11:01,443 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 13:11:01,443 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 13:11:01,443 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 13:11:01,446 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d5e24905ea8c385abbebf6a0b4d28aba, ASSIGN}] 2023-07-17 13:11:01,449 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d5e24905ea8c385abbebf6a0b4d28aba, ASSIGN 2023-07-17 13:11:01,451 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=d5e24905ea8c385abbebf6a0b4d28aba, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42601,1689599458269; forceNewPlan=false, retain=false 2023-07-17 13:11:01,604 INFO [jenkins-hbase4:44069] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-17 13:11:01,605 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d5e24905ea8c385abbebf6a0b4d28aba, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:01,606 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689599461201.d5e24905ea8c385abbebf6a0b4d28aba.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689599461605"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599461605"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599461605"}]},"ts":"1689599461605"} 2023-07-17 13:11:01,612 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure d5e24905ea8c385abbebf6a0b4d28aba, server=jenkins-hbase4.apache.org,42601,1689599458269}] 2023-07-17 13:11:01,775 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689599461201.d5e24905ea8c385abbebf6a0b4d28aba. 2023-07-17 13:11:01,775 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d5e24905ea8c385abbebf6a0b4d28aba, NAME => 'hbase:namespace,,1689599461201.d5e24905ea8c385abbebf6a0b4d28aba.', STARTKEY => '', ENDKEY => ''} 2023-07-17 13:11:01,776 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689599461201.d5e24905ea8c385abbebf6a0b4d28aba. service=AccessControlService 2023-07-17 13:11:01,777 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 13:11:01,777 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace d5e24905ea8c385abbebf6a0b4d28aba 2023-07-17 13:11:01,778 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689599461201.d5e24905ea8c385abbebf6a0b4d28aba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:11:01,778 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d5e24905ea8c385abbebf6a0b4d28aba 2023-07-17 13:11:01,778 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d5e24905ea8c385abbebf6a0b4d28aba 2023-07-17 13:11:01,781 INFO [StoreOpener-d5e24905ea8c385abbebf6a0b4d28aba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region d5e24905ea8c385abbebf6a0b4d28aba 2023-07-17 13:11:01,783 DEBUG [StoreOpener-d5e24905ea8c385abbebf6a0b4d28aba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/namespace/d5e24905ea8c385abbebf6a0b4d28aba/info 2023-07-17 13:11:01,783 DEBUG [StoreOpener-d5e24905ea8c385abbebf6a0b4d28aba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/namespace/d5e24905ea8c385abbebf6a0b4d28aba/info 2023-07-17 13:11:01,784 INFO [StoreOpener-d5e24905ea8c385abbebf6a0b4d28aba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d5e24905ea8c385abbebf6a0b4d28aba columnFamilyName info 2023-07-17 13:11:01,785 INFO [StoreOpener-d5e24905ea8c385abbebf6a0b4d28aba-1] regionserver.HStore(310): Store=d5e24905ea8c385abbebf6a0b4d28aba/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:11:01,787 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/namespace/d5e24905ea8c385abbebf6a0b4d28aba 2023-07-17 13:11:01,788 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/namespace/d5e24905ea8c385abbebf6a0b4d28aba 2023-07-17 13:11:01,793 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d5e24905ea8c385abbebf6a0b4d28aba 2023-07-17 13:11:01,797 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/namespace/d5e24905ea8c385abbebf6a0b4d28aba/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 13:11:01,798 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d5e24905ea8c385abbebf6a0b4d28aba; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60879817, jitterRate=-0.09282003343105316}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 13:11:01,798 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d5e24905ea8c385abbebf6a0b4d28aba: 2023-07-17 13:11:01,801 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689599461201.d5e24905ea8c385abbebf6a0b4d28aba., pid=6, masterSystemTime=1689599461767 2023-07-17 13:11:01,805 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689599461201.d5e24905ea8c385abbebf6a0b4d28aba. 2023-07-17 13:11:01,805 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689599461201.d5e24905ea8c385abbebf6a0b4d28aba. 2023-07-17 13:11:01,807 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d5e24905ea8c385abbebf6a0b4d28aba, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:01,807 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689599461201.d5e24905ea8c385abbebf6a0b4d28aba.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689599461806"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689599461806"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689599461806"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689599461806"}]},"ts":"1689599461806"} 2023-07-17 13:11:01,815 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-17 13:11:01,815 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure d5e24905ea8c385abbebf6a0b4d28aba, server=jenkins-hbase4.apache.org,42601,1689599458269 in 199 msec 2023-07-17 13:11:01,819 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-17 13:11:01,820 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=d5e24905ea8c385abbebf6a0b4d28aba, ASSIGN in 369 msec 2023-07-17 13:11:01,821 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 13:11:01,822 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599461821"}]},"ts":"1689599461821"} 2023-07-17 13:11:01,826 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-17 13:11:01,830 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 13:11:01,834 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 628 msec 2023-07-17 13:11:01,919 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-17 13:11:01,921 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-17 13:11:01,921 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 13:11:01,971 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-17 13:11:01,993 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-17 13:11:02,002 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 43 msec 2023-07-17 13:11:02,015 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-17 13:11:02,032 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-17 13:11:02,041 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 23 msec 2023-07-17 13:11:02,057 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-17 13:11:02,060 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-17 13:11:02,061 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.691sec 2023-07-17 13:11:02,064 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-17 13:11:02,066 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-17 13:11:02,067 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-17 13:11:02,068 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44069,1689599456641-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-17 13:11:02,069 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44069,1689599456641-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-17 13:11:02,094 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-17 13:11:02,097 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-17 13:11:02,100 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 13:11:02,102 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 13:11:02,105 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-17 13:11:02,105 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/hbase/acl/9f7c4b8f7e4feeacebf9d9bcd1ae3d42 2023-07-17 13:11:02,106 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/hbase/acl/9f7c4b8f7e4feeacebf9d9bcd1ae3d42 empty. 2023-07-17 13:11:02,109 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/hbase/acl/9f7c4b8f7e4feeacebf9d9bcd1ae3d42 2023-07-17 13:11:02,109 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-17 13:11:02,113 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-17 13:11:02,136 DEBUG [Listener at localhost/40321] zookeeper.ReadOnlyZKClient(139): Connect 0x1f336f33 to 127.0.0.1:56233 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:11:02,137 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-17 13:11:02,140 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9f7c4b8f7e4feeacebf9d9bcd1ae3d42, NAME => 'hbase:acl,,1689599462090.9f7c4b8f7e4feeacebf9d9bcd1ae3d42.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp 2023-07-17 13:11:02,149 DEBUG [Listener at localhost/40321] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7cbb53b4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:11:02,177 DEBUG [hconnection-0x11229028-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:02,177 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689599462090.9f7c4b8f7e4feeacebf9d9bcd1ae3d42.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:11:02,179 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 9f7c4b8f7e4feeacebf9d9bcd1ae3d42, disabling compactions & flushes 2023-07-17 13:11:02,179 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689599462090.9f7c4b8f7e4feeacebf9d9bcd1ae3d42. 2023-07-17 13:11:02,179 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689599462090.9f7c4b8f7e4feeacebf9d9bcd1ae3d42. 2023-07-17 13:11:02,179 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689599462090.9f7c4b8f7e4feeacebf9d9bcd1ae3d42. after waiting 0 ms 2023-07-17 13:11:02,179 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689599462090.9f7c4b8f7e4feeacebf9d9bcd1ae3d42. 2023-07-17 13:11:02,179 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689599462090.9f7c4b8f7e4feeacebf9d9bcd1ae3d42. 2023-07-17 13:11:02,179 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 9f7c4b8f7e4feeacebf9d9bcd1ae3d42: 2023-07-17 13:11:02,189 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 13:11:02,191 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689599462090.9f7c4b8f7e4feeacebf9d9bcd1ae3d42.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689599462191"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599462191"}]},"ts":"1689599462191"} 2023-07-17 13:11:02,199 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-17 13:11:02,200 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34174, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:11:02,202 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 13:11:02,202 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599462202"}]},"ts":"1689599462202"} 2023-07-17 13:11:02,205 INFO [Listener at localhost/40321] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,44069,1689599456641 2023-07-17 13:11:02,205 INFO [Listener at localhost/40321] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-17 13:11:02,205 INFO [Listener at localhost/40321] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/test.cache.data in system properties and HBase conf 2023-07-17 13:11:02,205 INFO [Listener at localhost/40321] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/hadoop.tmp.dir in system properties and HBase conf 2023-07-17 13:11:02,205 INFO [Listener at localhost/40321] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/hadoop.log.dir in system properties and HBase conf 2023-07-17 13:11:02,206 INFO [Listener at localhost/40321] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-17 13:11:02,206 INFO [Listener at localhost/40321] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-17 13:11:02,206 INFO [Listener at localhost/40321] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-17 13:11:02,206 INFO [Listener at localhost/40321] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-17 13:11:02,206 INFO [Listener at localhost/40321] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-17 13:11:02,206 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-17 13:11:02,206 INFO [Listener at localhost/40321] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-17 13:11:02,207 INFO [Listener at localhost/40321] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-17 13:11:02,207 INFO [Listener at localhost/40321] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-17 13:11:02,207 INFO [Listener at localhost/40321] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-17 13:11:02,207 INFO [Listener at localhost/40321] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-17 13:11:02,207 INFO [Listener at localhost/40321] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-17 13:11:02,207 INFO [Listener at localhost/40321] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-17 13:11:02,208 INFO [Listener at localhost/40321] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/nfs.dump.dir in system properties and HBase conf 2023-07-17 13:11:02,208 INFO [Listener at localhost/40321] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/java.io.tmpdir in system properties and HBase conf 2023-07-17 13:11:02,208 INFO [Listener at localhost/40321] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-17 13:11:02,208 INFO [Listener at localhost/40321] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-17 13:11:02,208 INFO [Listener at localhost/40321] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-17 13:11:02,212 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 13:11:02,213 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 13:11:02,214 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 13:11:02,214 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 13:11:02,214 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 13:11:02,214 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=9f7c4b8f7e4feeacebf9d9bcd1ae3d42, ASSIGN}] 2023-07-17 13:11:02,217 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-17 13:11:02,221 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=9f7c4b8f7e4feeacebf9d9bcd1ae3d42, ASSIGN 2023-07-17 13:11:02,225 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=9f7c4b8f7e4feeacebf9d9bcd1ae3d42, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43575,1689599458131; forceNewPlan=false, retain=false 2023-07-17 13:11:02,375 INFO [jenkins-hbase4:44069] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-17 13:11:02,376 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=9f7c4b8f7e4feeacebf9d9bcd1ae3d42, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:02,377 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689599462090.9f7c4b8f7e4feeacebf9d9bcd1ae3d42.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689599462376"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599462376"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599462376"}]},"ts":"1689599462376"} 2023-07-17 13:11:02,380 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 9f7c4b8f7e4feeacebf9d9bcd1ae3d42, server=jenkins-hbase4.apache.org,43575,1689599458131}] 2023-07-17 13:11:02,418 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-17 13:11:02,535 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:02,535 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-17 13:11:02,540 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34548, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-17 13:11:02,548 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689599462090.9f7c4b8f7e4feeacebf9d9bcd1ae3d42. 2023-07-17 13:11:02,548 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9f7c4b8f7e4feeacebf9d9bcd1ae3d42, NAME => 'hbase:acl,,1689599462090.9f7c4b8f7e4feeacebf9d9bcd1ae3d42.', STARTKEY => '', ENDKEY => ''} 2023-07-17 13:11:02,549 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689599462090.9f7c4b8f7e4feeacebf9d9bcd1ae3d42. service=AccessControlService 2023-07-17 13:11:02,549 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 13:11:02,549 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 9f7c4b8f7e4feeacebf9d9bcd1ae3d42 2023-07-17 13:11:02,549 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689599462090.9f7c4b8f7e4feeacebf9d9bcd1ae3d42.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:11:02,549 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9f7c4b8f7e4feeacebf9d9bcd1ae3d42 2023-07-17 13:11:02,549 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9f7c4b8f7e4feeacebf9d9bcd1ae3d42 2023-07-17 13:11:02,555 INFO [StoreOpener-9f7c4b8f7e4feeacebf9d9bcd1ae3d42-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 9f7c4b8f7e4feeacebf9d9bcd1ae3d42 2023-07-17 13:11:02,558 DEBUG [StoreOpener-9f7c4b8f7e4feeacebf9d9bcd1ae3d42-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/acl/9f7c4b8f7e4feeacebf9d9bcd1ae3d42/l 2023-07-17 13:11:02,558 DEBUG [StoreOpener-9f7c4b8f7e4feeacebf9d9bcd1ae3d42-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/acl/9f7c4b8f7e4feeacebf9d9bcd1ae3d42/l 2023-07-17 13:11:02,559 INFO [StoreOpener-9f7c4b8f7e4feeacebf9d9bcd1ae3d42-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9f7c4b8f7e4feeacebf9d9bcd1ae3d42 columnFamilyName l 2023-07-17 13:11:02,560 INFO [StoreOpener-9f7c4b8f7e4feeacebf9d9bcd1ae3d42-1] regionserver.HStore(310): Store=9f7c4b8f7e4feeacebf9d9bcd1ae3d42/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:11:02,562 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/acl/9f7c4b8f7e4feeacebf9d9bcd1ae3d42 2023-07-17 13:11:02,564 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/acl/9f7c4b8f7e4feeacebf9d9bcd1ae3d42 2023-07-17 13:11:02,571 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9f7c4b8f7e4feeacebf9d9bcd1ae3d42 2023-07-17 13:11:02,584 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/acl/9f7c4b8f7e4feeacebf9d9bcd1ae3d42/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 13:11:02,587 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9f7c4b8f7e4feeacebf9d9bcd1ae3d42; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69307101, jitterRate=0.03275628387928009}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 13:11:02,588 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9f7c4b8f7e4feeacebf9d9bcd1ae3d42: 2023-07-17 13:11:02,589 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689599462090.9f7c4b8f7e4feeacebf9d9bcd1ae3d42., pid=11, masterSystemTime=1689599462535 2023-07-17 13:11:02,594 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689599462090.9f7c4b8f7e4feeacebf9d9bcd1ae3d42. 2023-07-17 13:11:02,595 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689599462090.9f7c4b8f7e4feeacebf9d9bcd1ae3d42. 2023-07-17 13:11:02,596 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=9f7c4b8f7e4feeacebf9d9bcd1ae3d42, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:02,597 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689599462090.9f7c4b8f7e4feeacebf9d9bcd1ae3d42.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689599462596"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689599462596"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689599462596"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689599462596"}]},"ts":"1689599462596"} 2023-07-17 13:11:02,607 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-17 13:11:02,607 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 9f7c4b8f7e4feeacebf9d9bcd1ae3d42, server=jenkins-hbase4.apache.org,43575,1689599458131 in 220 msec 2023-07-17 13:11:02,611 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-17 13:11:02,611 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=9f7c4b8f7e4feeacebf9d9bcd1ae3d42, ASSIGN in 393 msec 2023-07-17 13:11:02,612 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 13:11:02,613 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599462612"}]},"ts":"1689599462612"} 2023-07-17 13:11:02,615 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-17 13:11:02,622 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 13:11:02,625 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 527 msec 2023-07-17 13:11:02,718 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-17 13:11:02,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-17 13:11:02,731 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-17 13:11:03,675 WARN [Thread-382] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 13:11:04,070 INFO [Thread-382] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 13:11:04,083 INFO [Thread-382] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_43255_jobhistory____.awxaxw/webapp 2023-07-17 13:11:04,299 INFO [Thread-382] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-17 13:11:04,299 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-17 13:11:04,299 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-17 13:11:04,304 INFO [Thread-382] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-17 13:11:04,406 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 13:11:04,846 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 13:11:05,426 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-17 13:11:05,473 INFO [Thread-382] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:43255 2023-07-17 13:11:06,436 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 13:11:06,754 WARN [Listener at jenkins-hbase4.apache.org/37943] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 13:11:06,758 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-17 13:11:06,759 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-17 13:11:06,761 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-17 13:11:06,830 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:11:06,831 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-17 13:11:06,831 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:11:06,831 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-17 13:11:06,832 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-17 13:11:06,832 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-17 13:11:06,832 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:11:06,832 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-17 13:11:06,832 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-17 13:11:06,832 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-17 13:11:06,867 WARN [Listener at jenkins-hbase4.apache.org/37943] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-17 13:11:06,867 INFO [Listener at jenkins-hbase4.apache.org/37943] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 13:11:06,876 INFO [Listener at jenkins-hbase4.apache.org/37943] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_38707_cluster____.awg7p1/webapp 2023-07-17 13:11:06,951 INFO [Listener at jenkins-hbase4.apache.org/37943] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-17 13:11:06,951 INFO [Listener at jenkins-hbase4.apache.org/37943] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-17 13:11:06,951 INFO [Listener at jenkins-hbase4.apache.org/37943] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-17 13:11:06,952 INFO [Listener at jenkins-hbase4.apache.org/37943] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-17 13:11:06,961 INFO [Listener at jenkins-hbase4.apache.org/37943] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 13:11:07,169 INFO [Listener at jenkins-hbase4.apache.org/37943] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 13:11:07,296 INFO [Listener at jenkins-hbase4.apache.org/37943] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 13:11:07,316 INFO [Listener at jenkins-hbase4.apache.org/37943] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:38707 2023-07-17 13:11:07,863 WARN [Listener at jenkins-hbase4.apache.org/43347] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 13:11:07,895 WARN [Listener at jenkins-hbase4.apache.org/43347] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-17 13:11:07,896 INFO [Listener at jenkins-hbase4.apache.org/43347] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 13:11:07,915 INFO [Listener at jenkins-hbase4.apache.org/43347] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34335_node____oyrw2a/webapp 2023-07-17 13:11:07,991 INFO [Listener at jenkins-hbase4.apache.org/43347] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-17 13:11:07,991 INFO [Listener at jenkins-hbase4.apache.org/43347] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-17 13:11:07,992 INFO [Listener at jenkins-hbase4.apache.org/43347] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-17 13:11:07,992 INFO [Listener at jenkins-hbase4.apache.org/43347] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-17 13:11:08,003 INFO [Listener at jenkins-hbase4.apache.org/43347] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 13:11:08,035 INFO [Listener at jenkins-hbase4.apache.org/43347] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 13:11:08,175 INFO [Listener at jenkins-hbase4.apache.org/43347] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 13:11:08,199 INFO [Listener at jenkins-hbase4.apache.org/43347] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34335 2023-07-17 13:11:08,427 WARN [Listener at jenkins-hbase4.apache.org/38153] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 13:11:08,437 WARN [Listener at jenkins-hbase4.apache.org/38153] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-17 13:11:08,438 INFO [Listener at jenkins-hbase4.apache.org/38153] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 13:11:08,448 INFO [Listener at jenkins-hbase4.apache.org/38153] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_37905_node____4vejq0/webapp 2023-07-17 13:11:08,522 INFO [Listener at jenkins-hbase4.apache.org/38153] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-17 13:11:08,523 INFO [Listener at jenkins-hbase4.apache.org/38153] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-17 13:11:08,523 INFO [Listener at jenkins-hbase4.apache.org/38153] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-17 13:11:08,523 INFO [Listener at jenkins-hbase4.apache.org/38153] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-17 13:11:08,535 INFO [Listener at jenkins-hbase4.apache.org/38153] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 13:11:08,559 INFO [Listener at jenkins-hbase4.apache.org/38153] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 13:11:08,658 INFO [Listener at jenkins-hbase4.apache.org/38153] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 13:11:08,683 INFO [Listener at jenkins-hbase4.apache.org/38153] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:37905 2023-07-17 13:11:08,710 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-17 13:11:08,711 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 13:11:08,790 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=707, OpenFileDescriptor=894, MaxFileDescriptor=60000, SystemLoadAverage=389, ProcessCount=174, AvailableMemoryMB=5029 2023-07-17 13:11:08,791 WARN [Listener at jenkins-hbase4.apache.org/38153] hbase.ResourceChecker(130): Thread=707 is superior to 500 2023-07-17 13:11:08,806 DEBUG [Listener at jenkins-hbase4.apache.org/38153] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-17 13:11:08,813 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35414, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-17 13:11:08,822 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-17 13:11:08,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-17 13:11:08,829 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 13:11:08,829 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-17 13:11:08,832 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 13:11:08,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-17 13:11:08,837 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportWithTargetName/1cc7f80304d71b006c0d2331db66bd4b 2023-07-17 13:11:08,838 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportWithTargetName/f3a34c6818cb8118662075656e1d18d0 2023-07-17 13:11:08,840 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportWithTargetName/1cc7f80304d71b006c0d2331db66bd4b empty. 2023-07-17 13:11:08,842 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportWithTargetName/f3a34c6818cb8118662075656e1d18d0 empty. 2023-07-17 13:11:08,844 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportWithTargetName/1cc7f80304d71b006c0d2331db66bd4b 2023-07-17 13:11:08,844 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportWithTargetName/f3a34c6818cb8118662075656e1d18d0 2023-07-17 13:11:08,844 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-17 13:11:08,898 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-17 13:11:08,900 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1cc7f80304d71b006c0d2331db66bd4b, NAME => 'testtb-testExportWithTargetName,,1689599468821.1cc7f80304d71b006c0d2331db66bd4b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp 2023-07-17 13:11:08,904 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => f3a34c6818cb8118662075656e1d18d0, NAME => 'testtb-testExportWithTargetName,1,1689599468821.f3a34c6818cb8118662075656e1d18d0.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp 2023-07-17 13:11:08,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-17 13:11:08,956 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689599468821.1cc7f80304d71b006c0d2331db66bd4b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:11:08,957 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 1cc7f80304d71b006c0d2331db66bd4b, disabling compactions & flushes 2023-07-17 13:11:08,957 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689599468821.1cc7f80304d71b006c0d2331db66bd4b. 2023-07-17 13:11:08,958 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689599468821.1cc7f80304d71b006c0d2331db66bd4b. 2023-07-17 13:11:08,958 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689599468821.1cc7f80304d71b006c0d2331db66bd4b. after waiting 0 ms 2023-07-17 13:11:08,958 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689599468821.1cc7f80304d71b006c0d2331db66bd4b. 2023-07-17 13:11:08,958 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689599468821.1cc7f80304d71b006c0d2331db66bd4b. 2023-07-17 13:11:08,958 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 1cc7f80304d71b006c0d2331db66bd4b: 2023-07-17 13:11:08,958 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689599468821.f3a34c6818cb8118662075656e1d18d0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:11:08,958 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing f3a34c6818cb8118662075656e1d18d0, disabling compactions & flushes 2023-07-17 13:11:08,958 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689599468821.f3a34c6818cb8118662075656e1d18d0. 2023-07-17 13:11:08,959 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689599468821.f3a34c6818cb8118662075656e1d18d0. 2023-07-17 13:11:08,959 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689599468821.f3a34c6818cb8118662075656e1d18d0. after waiting 0 ms 2023-07-17 13:11:08,959 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689599468821.f3a34c6818cb8118662075656e1d18d0. 2023-07-17 13:11:08,959 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689599468821.f3a34c6818cb8118662075656e1d18d0. 2023-07-17 13:11:08,959 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for f3a34c6818cb8118662075656e1d18d0: 2023-07-17 13:11:08,963 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 13:11:08,964 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689599468821.1cc7f80304d71b006c0d2331db66bd4b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689599468964"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599468964"}]},"ts":"1689599468964"} 2023-07-17 13:11:08,964 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689599468821.f3a34c6818cb8118662075656e1d18d0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689599468964"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599468964"}]},"ts":"1689599468964"} 2023-07-17 13:11:09,019 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 13:11:09,021 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 13:11:09,021 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599469021"}]},"ts":"1689599469021"} 2023-07-17 13:11:09,023 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-17 13:11:09,028 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 13:11:09,030 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 13:11:09,030 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 13:11:09,030 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 13:11:09,030 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 13:11:09,030 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1cc7f80304d71b006c0d2331db66bd4b, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f3a34c6818cb8118662075656e1d18d0, ASSIGN}] 2023-07-17 13:11:09,034 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f3a34c6818cb8118662075656e1d18d0, ASSIGN 2023-07-17 13:11:09,034 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1cc7f80304d71b006c0d2331db66bd4b, ASSIGN 2023-07-17 13:11:09,035 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f3a34c6818cb8118662075656e1d18d0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45883,1689599458200; forceNewPlan=false, retain=false 2023-07-17 13:11:09,035 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1cc7f80304d71b006c0d2331db66bd4b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43575,1689599458131; forceNewPlan=false, retain=false 2023-07-17 13:11:09,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-17 13:11:09,185 INFO [jenkins-hbase4:44069] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 13:11:09,188 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=1cc7f80304d71b006c0d2331db66bd4b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:09,188 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=f3a34c6818cb8118662075656e1d18d0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:09,188 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689599468821.1cc7f80304d71b006c0d2331db66bd4b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689599469188"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599469188"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599469188"}]},"ts":"1689599469188"} 2023-07-17 13:11:09,188 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689599468821.f3a34c6818cb8118662075656e1d18d0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689599469188"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599469188"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599469188"}]},"ts":"1689599469188"} 2023-07-17 13:11:09,191 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 1cc7f80304d71b006c0d2331db66bd4b, server=jenkins-hbase4.apache.org,43575,1689599458131}] 2023-07-17 13:11:09,192 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure f3a34c6818cb8118662075656e1d18d0, server=jenkins-hbase4.apache.org,45883,1689599458200}] 2023-07-17 13:11:09,347 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:09,347 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-17 13:11:09,351 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34640, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-17 13:11:09,355 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689599468821.1cc7f80304d71b006c0d2331db66bd4b. 2023-07-17 13:11:09,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1cc7f80304d71b006c0d2331db66bd4b, NAME => 'testtb-testExportWithTargetName,,1689599468821.1cc7f80304d71b006c0d2331db66bd4b.', STARTKEY => '', ENDKEY => '1'} 2023-07-17 13:11:09,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689599468821.1cc7f80304d71b006c0d2331db66bd4b. service=AccessControlService 2023-07-17 13:11:09,356 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 13:11:09,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 1cc7f80304d71b006c0d2331db66bd4b 2023-07-17 13:11:09,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689599468821.1cc7f80304d71b006c0d2331db66bd4b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:11:09,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1cc7f80304d71b006c0d2331db66bd4b 2023-07-17 13:11:09,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1cc7f80304d71b006c0d2331db66bd4b 2023-07-17 13:11:09,358 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689599468821.f3a34c6818cb8118662075656e1d18d0. 2023-07-17 13:11:09,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f3a34c6818cb8118662075656e1d18d0, NAME => 'testtb-testExportWithTargetName,1,1689599468821.f3a34c6818cb8118662075656e1d18d0.', STARTKEY => '1', ENDKEY => ''} 2023-07-17 13:11:09,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689599468821.f3a34c6818cb8118662075656e1d18d0. service=AccessControlService 2023-07-17 13:11:09,358 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 13:11:09,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName f3a34c6818cb8118662075656e1d18d0 2023-07-17 13:11:09,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689599468821.f3a34c6818cb8118662075656e1d18d0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:11:09,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f3a34c6818cb8118662075656e1d18d0 2023-07-17 13:11:09,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f3a34c6818cb8118662075656e1d18d0 2023-07-17 13:11:09,359 INFO [StoreOpener-1cc7f80304d71b006c0d2331db66bd4b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1cc7f80304d71b006c0d2331db66bd4b 2023-07-17 13:11:09,361 INFO [StoreOpener-f3a34c6818cb8118662075656e1d18d0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f3a34c6818cb8118662075656e1d18d0 2023-07-17 13:11:09,362 DEBUG [StoreOpener-1cc7f80304d71b006c0d2331db66bd4b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportWithTargetName/1cc7f80304d71b006c0d2331db66bd4b/cf 2023-07-17 13:11:09,362 DEBUG [StoreOpener-1cc7f80304d71b006c0d2331db66bd4b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportWithTargetName/1cc7f80304d71b006c0d2331db66bd4b/cf 2023-07-17 13:11:09,363 INFO [StoreOpener-1cc7f80304d71b006c0d2331db66bd4b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1cc7f80304d71b006c0d2331db66bd4b columnFamilyName cf 2023-07-17 13:11:09,364 INFO [StoreOpener-1cc7f80304d71b006c0d2331db66bd4b-1] regionserver.HStore(310): Store=1cc7f80304d71b006c0d2331db66bd4b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:11:09,364 DEBUG [StoreOpener-f3a34c6818cb8118662075656e1d18d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportWithTargetName/f3a34c6818cb8118662075656e1d18d0/cf 2023-07-17 13:11:09,365 DEBUG [StoreOpener-f3a34c6818cb8118662075656e1d18d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportWithTargetName/f3a34c6818cb8118662075656e1d18d0/cf 2023-07-17 13:11:09,366 INFO [StoreOpener-f3a34c6818cb8118662075656e1d18d0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f3a34c6818cb8118662075656e1d18d0 columnFamilyName cf 2023-07-17 13:11:09,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportWithTargetName/1cc7f80304d71b006c0d2331db66bd4b 2023-07-17 13:11:09,366 INFO [StoreOpener-f3a34c6818cb8118662075656e1d18d0-1] regionserver.HStore(310): Store=f3a34c6818cb8118662075656e1d18d0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:11:09,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportWithTargetName/1cc7f80304d71b006c0d2331db66bd4b 2023-07-17 13:11:09,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportWithTargetName/f3a34c6818cb8118662075656e1d18d0 2023-07-17 13:11:09,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportWithTargetName/f3a34c6818cb8118662075656e1d18d0 2023-07-17 13:11:09,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1cc7f80304d71b006c0d2331db66bd4b 2023-07-17 13:11:09,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f3a34c6818cb8118662075656e1d18d0 2023-07-17 13:11:09,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportWithTargetName/1cc7f80304d71b006c0d2331db66bd4b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 13:11:09,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportWithTargetName/f3a34c6818cb8118662075656e1d18d0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 13:11:09,386 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1cc7f80304d71b006c0d2331db66bd4b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63850290, jitterRate=-0.04855653643608093}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 13:11:09,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1cc7f80304d71b006c0d2331db66bd4b: 2023-07-17 13:11:09,386 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f3a34c6818cb8118662075656e1d18d0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66268572, jitterRate=-0.012521326541900635}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 13:11:09,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f3a34c6818cb8118662075656e1d18d0: 2023-07-17 13:11:09,387 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689599468821.1cc7f80304d71b006c0d2331db66bd4b., pid=15, masterSystemTime=1689599469343 2023-07-17 13:11:09,388 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689599468821.f3a34c6818cb8118662075656e1d18d0., pid=16, masterSystemTime=1689599469347 2023-07-17 13:11:09,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689599468821.1cc7f80304d71b006c0d2331db66bd4b. 2023-07-17 13:11:09,394 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689599468821.1cc7f80304d71b006c0d2331db66bd4b. 2023-07-17 13:11:09,395 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=1cc7f80304d71b006c0d2331db66bd4b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:09,395 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689599468821.1cc7f80304d71b006c0d2331db66bd4b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689599469395"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689599469395"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689599469395"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689599469395"}]},"ts":"1689599469395"} 2023-07-17 13:11:09,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689599468821.f3a34c6818cb8118662075656e1d18d0. 2023-07-17 13:11:09,396 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689599468821.f3a34c6818cb8118662075656e1d18d0. 2023-07-17 13:11:09,397 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=f3a34c6818cb8118662075656e1d18d0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:09,400 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689599468821.f3a34c6818cb8118662075656e1d18d0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689599469397"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689599469397"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689599469397"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689599469397"}]},"ts":"1689599469397"} 2023-07-17 13:11:09,407 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-17 13:11:09,408 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 1cc7f80304d71b006c0d2331db66bd4b, server=jenkins-hbase4.apache.org,43575,1689599458131 in 212 msec 2023-07-17 13:11:09,409 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-17 13:11:09,410 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure f3a34c6818cb8118662075656e1d18d0, server=jenkins-hbase4.apache.org,45883,1689599458200 in 212 msec 2023-07-17 13:11:09,411 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1cc7f80304d71b006c0d2331db66bd4b, ASSIGN in 377 msec 2023-07-17 13:11:09,413 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=12 2023-07-17 13:11:09,413 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f3a34c6818cb8118662075656e1d18d0, ASSIGN in 380 msec 2023-07-17 13:11:09,414 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 13:11:09,415 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599469414"}]},"ts":"1689599469414"} 2023-07-17 13:11:09,417 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-17 13:11:09,420 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 13:11:09,425 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-17 13:11:09,431 DEBUG [PEWorker-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:09,434 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34556, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:11:09,440 DEBUG [hconnection-0x67639f9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:09,444 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34190, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2023-07-17 13:11:09,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-17 13:11:09,453 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43575] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-17 13:11:09,490 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-17 13:11:09,490 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-17 13:11:09,490 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-17 13:11:09,490 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-17 13:11:09,490 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 13:11:09,506 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-17 13:11:09,506 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-17 13:11:09,506 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-17 13:11:09,506 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-17 13:11:09,510 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 684 msec 2023-07-17 13:11:09,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-17 13:11:09,951 INFO [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-17 13:11:09,951 DEBUG [Listener at jenkins-hbase4.apache.org/38153] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-17 13:11:09,953 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 13:11:09,957 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-17 13:11:09,958 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 13:11:09,958 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-17 13:11:09,975 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-17 13:11:09,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689599469975 (current time:1689599469975). 2023-07-17 13:11:09,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 13:11:09,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(139): Connect 0x5053b960 to 127.0.0.1:56233 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:11:09,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26f2e95e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:11:09,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:09,986 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34206, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:11:09,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5053b960 to 127.0.0.1:56233 2023-07-17 13:11:09,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:11:09,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(139): Connect 0x3df6c590 to 127.0.0.1:56233 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:11:09,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5995d6b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:11:09,998 DEBUG [hconnection-0x16c57e00-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:10,000 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34214, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:11:10,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:10,006 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34570, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:11:10,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3df6c590 to 127.0.0.1:56233 2023-07-17 13:11:10,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:11:10,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-17 13:11:10,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 13:11:10,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-17 13:11:10,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-17 13:11:10,074 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-17 13:11:10,075 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689600070075 2023-07-17 13:11:10,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-17 13:11:10,076 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-17 13:11:10,080 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-17 13:11:10,081 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-17 13:11:10,084 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 13:11:10,084 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 13:11:10,085 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 18 msec 2023-07-17 13:11:10,087 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-17 13:11:10,090 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689600070090 2023-07-17 13:11:10,123 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,124 INFO [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-17 13:11:10,124 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:10,125 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-17 13:11:10,125 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-17 13:11:10,126 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,126 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,131 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:10,131 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:10,131 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:10,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:10,131 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:10,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:10,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:10,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:10,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:10,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:10,132 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:10,132 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:10,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,133 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:10,133 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 13:11:10,133 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,133 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,133 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-17 13:11:10,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-17 13:11:10,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-17 13:11:10,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,134 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-17 13:11:10,134 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-17 13:11:10,134 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-17 13:11:10,137 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,137 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,138 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,139 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-17 13:11:10,139 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:10,139 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-17 13:11:10,140 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-17 13:11:10,140 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:10,140 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-17 13:11:10,142 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-17 13:11:10,142 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-17 13:11:10,140 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-17 13:11:10,142 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42601,1689599458269' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-17 13:11:10,142 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:10,142 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45883,1689599458200' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-17 13:11:10,143 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-17 13:11:10,143 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-17 13:11:10,143 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43575,1689599458131' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-17 13:11:10,146 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,149 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:10,149 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,149 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:10,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:10,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:10,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:10,149 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,149 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,150 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:11:10,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:10,150 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,150 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:11:10,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:10,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:10,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:10,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:10,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:10,153 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45883,1689599458200' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-17 13:11:10,153 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d783637[Count = 1] remaining members to acquire global barrier 2023-07-17 13:11:10,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:10,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:10,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:10,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:10,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:10,155 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,155 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:11:10,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:10,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:10,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:10,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:10,157 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43575,1689599458131' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-17 13:11:10,158 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d783637[Count = 0] remaining members to acquire global barrier 2023-07-17 13:11:10,158 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-17 13:11:10,158 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,160 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,160 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,161 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-17 13:11:10,160 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,161 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-17 13:11:10,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,161 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-17 13:11:10,161 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-17 13:11:10,161 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42601,1689599458269' in zk 2023-07-17 13:11:10,162 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:10,162 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:11:10,163 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:11:10,163 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689599468821.f3a34c6818cb8118662075656e1d18d0. 2023-07-17 13:11:10,163 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689599468821.f3a34c6818cb8118662075656e1d18d0. started... 2023-07-17 13:11:10,167 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:11:10,172 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689599468821.1cc7f80304d71b006c0d2331db66bd4b. 2023-07-17 13:11:10,172 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689599468821.1cc7f80304d71b006c0d2331db66bd4b. started... 2023-07-17 13:11:10,172 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:11:10,172 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-17 13:11:10,172 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:10,172 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:10,173 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 13:11:10,174 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-17 13:11:10,176 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f3a34c6818cb8118662075656e1d18d0: 2023-07-17 13:11:10,176 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1cc7f80304d71b006c0d2331db66bd4b: 2023-07-17 13:11:10,177 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689599468821.f3a34c6818cb8118662075656e1d18d0.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,177 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689599468821.1cc7f80304d71b006c0d2331db66bd4b.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,183 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:11:10,183 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:11:10,184 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:11:10,187 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 13:11:10,187 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 13:11:10,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-17 13:11:10,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-17 13:11:10,189 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 13:11:10,239 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689599468821.f3a34c6818cb8118662075656e1d18d0. completed. 2023-07-17 13:11:10,239 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689599468821.f3a34c6818cb8118662075656e1d18d0. 2023-07-17 13:11:10,240 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:11:10,241 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:11:10,241 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:10,242 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-17 13:11:10,243 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45883,1689599458200' in zk 2023-07-17 13:11:10,248 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689599468821.1cc7f80304d71b006c0d2331db66bd4b. completed. 2023-07-17 13:11:10,248 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689599468821.1cc7f80304d71b006c0d2331db66bd4b. 2023-07-17 13:11:10,248 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:11:10,248 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:11:10,248 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:10,248 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-17 13:11:10,249 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43575,1689599458131' in zk 2023-07-17 13:11:10,254 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-17 13:11:10,254 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:10,255 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-17 13:11:10,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:10,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:10,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:10,254 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:10,255 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:10,255 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:10,255 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-17 13:11:10,255 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-17 13:11:10,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:10,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:10,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:10,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:10,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:10,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:10,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:10,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:10,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:10,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45883,1689599458200': 2023-07-17 13:11:10,262 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45883,1689599458200' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-17 13:11:10,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:10,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:10,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:10,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:10,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:10,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:10,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:10,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:10,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:10,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:10,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:10,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:10,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43575,1689599458131': 2023-07-17 13:11:10,267 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43575,1689599458131' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-17 13:11:10,267 INFO [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-17 13:11:10,268 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 13:11:10,268 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 13:11:10,268 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,268 INFO [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 13:11:10,273 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,273 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:10,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,274 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,274 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:10,274 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,274 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:10,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:10,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,274 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:10,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:10,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:10,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:10,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:10,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:10,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:10,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:10,276 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:10,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,277 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:10,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:10,278 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:10,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:10,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:10,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:10,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:10,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,281 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:10,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:10,281 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:10,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:10,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:10,282 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:10,301 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:10,301 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:10,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:10,302 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:10,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:10,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:10,302 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:10,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:10,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:10,302 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:10,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:10,302 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:10,302 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:10,302 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,303 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:10,303 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:10,303 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,303 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:10,303 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:10,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:10,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:10,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:10,303 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:10,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:10,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:10,303 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:10,303 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,303 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,304 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:10,304 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,306 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,309 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,366 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,390 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:11:10,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-17 13:11:10,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-17 13:11:10,393 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 13:11:10,416 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-17 13:11:10,417 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,418 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,418 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689599470076Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689599470306 (+230 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689599470306Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689599470325 (+19 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689599470354 (+29 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689599470416 (+62 ms) 2023-07-17 13:11:10,420 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-17 13:11:10,423 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 340 msec 2023-07-17 13:11:10,693 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:11:10,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-17 13:11:10,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 13:11:10,718 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:10,718 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:10,726 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35850, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:11:10,727 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58846, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:11:10,727 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43575] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689599468821.1cc7f80304d71b006c0d2331db66bd4b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 13:11:10,730 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45883] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689599468821.f3a34c6818cb8118662075656e1d18d0. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 13:11:10,736 DEBUG [Listener at jenkins-hbase4.apache.org/38153] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-17 13:11:10,737 DEBUG [Listener at jenkins-hbase4.apache.org/38153] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689599468821.1cc7f80304d71b006c0d2331db66bd4b. 2023-07-17 13:11:10,739 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 13:11:10,772 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-17 13:11:10,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689599470773 (current time:1689599470773). 2023-07-17 13:11:10,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 13:11:10,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(139): Connect 0x4f20117e to 127.0.0.1:56233 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:11:10,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@388ac046, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:11:10,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:10,785 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36310, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:11:10,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f20117e to 127.0.0.1:56233 2023-07-17 13:11:10,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:11:10,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(139): Connect 0x3c2b7372 to 127.0.0.1:56233 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:11:10,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@734f3e68, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:11:10,801 DEBUG [hconnection-0x1d2958b7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:10,805 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36318, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:11:10,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:10,812 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35864, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:11:10,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c2b7372 to 127.0.0.1:56233 2023-07-17 13:11:10,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:11:10,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-17 13:11:10,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 13:11:10,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-17 13:11:10,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-17 13:11:10,819 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-17 13:11:10,821 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689600070821 2023-07-17 13:11:10,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-17 13:11:10,821 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-17 13:11:10,822 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 13:11:10,822 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 13:11:10,824 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-17 13:11:10,824 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-17 13:11:10,825 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 7 msec 2023-07-17 13:11:10,826 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-17 13:11:10,827 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689600070827 2023-07-17 13:11:10,844 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-17 13:11:10,845 INFO [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-17 13:11:10,845 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:10,846 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-17 13:11:10,846 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-17 13:11:10,846 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,846 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,848 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:10,848 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:10,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:10,848 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:10,849 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:10,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:10,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:10,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:10,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:10,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:10,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,849 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:10,849 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:10,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,850 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,850 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,850 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:10,850 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 13:11:10,850 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-17 13:11:10,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-17 13:11:10,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,851 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-17 13:11:10,851 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-17 13:11:10,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-17 13:11:10,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,852 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-17 13:11:10,852 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-17 13:11:10,852 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-17 13:11:10,852 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:10,855 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-17 13:11:10,855 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-17 13:11:10,855 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42601,1689599458269' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-17 13:11:10,861 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,861 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,862 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:11:10,862 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-17 13:11:10,862 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-17 13:11:10,863 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-17 13:11:10,863 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-17 13:11:10,863 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:10,863 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:10,864 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-17 13:11:10,867 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-17 13:11:10,867 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-17 13:11:10,867 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-17 13:11:10,867 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45883,1689599458200' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-17 13:11:10,867 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43575,1689599458131' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-17 13:11:10,869 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:10,869 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:10,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:10,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:10,869 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:10,869 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,870 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,870 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:11:10,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:10,870 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,870 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:11:10,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:10,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 13:11:10,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:10,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:10,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:10,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:10,874 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45883,1689599458200' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-17 13:11:10,874 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@618d37b1[Count = 1] remaining members to acquire global barrier 2023-07-17 13:11:10,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:10,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:10,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:10,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:10,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:10,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 13:11:10,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:10,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:10,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:10,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:10,877 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43575,1689599458131' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-17 13:11:10,877 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@618d37b1[Count = 0] remaining members to acquire global barrier 2023-07-17 13:11:10,877 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-17 13:11:10,877 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,882 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,882 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,882 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,883 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-17 13:11:10,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,883 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-17 13:11:10,883 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-17 13:11:10,883 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-17 13:11:10,883 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42601,1689599458269' in zk 2023-07-17 13:11:10,882 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:10,883 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:10,884 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 13:11:10,883 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689599468821.1cc7f80304d71b006c0d2331db66bd4b. 2023-07-17 13:11:10,883 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:11:10,884 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:11:10,884 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689599468821.1cc7f80304d71b006c0d2331db66bd4b. started... 2023-07-17 13:11:10,884 INFO [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1cc7f80304d71b006c0d2331db66bd4b 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-17 13:11:10,888 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:11:10,888 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:11:10,888 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689599468821.f3a34c6818cb8118662075656e1d18d0. 2023-07-17 13:11:10,888 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689599468821.f3a34c6818cb8118662075656e1d18d0. started... 2023-07-17 13:11:10,888 INFO [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f3a34c6818cb8118662075656e1d18d0 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-17 13:11:10,890 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-17 13:11:10,890 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:10,890 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-17 13:11:10,922 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:11:10,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-17 13:11:10,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-17 13:11:10,925 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 13:11:11,021 INFO [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportWithTargetName/1cc7f80304d71b006c0d2331db66bd4b/.tmp/cf/9da6fdcaccca49769f281f2e5b4b73fb 2023-07-17 13:11:11,021 INFO [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportWithTargetName/f3a34c6818cb8118662075656e1d18d0/.tmp/cf/7bc038db2e0b4dc1a45f79828b8e265a 2023-07-17 13:11:11,082 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportWithTargetName/f3a34c6818cb8118662075656e1d18d0/.tmp/cf/7bc038db2e0b4dc1a45f79828b8e265a as hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportWithTargetName/f3a34c6818cb8118662075656e1d18d0/cf/7bc038db2e0b4dc1a45f79828b8e265a 2023-07-17 13:11:11,082 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportWithTargetName/1cc7f80304d71b006c0d2331db66bd4b/.tmp/cf/9da6fdcaccca49769f281f2e5b4b73fb as hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportWithTargetName/1cc7f80304d71b006c0d2331db66bd4b/cf/9da6fdcaccca49769f281f2e5b4b73fb 2023-07-17 13:11:11,093 INFO [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportWithTargetName/f3a34c6818cb8118662075656e1d18d0/cf/7bc038db2e0b4dc1a45f79828b8e265a, entries=48, sequenceid=6, filesize=8.1 K 2023-07-17 13:11:11,096 INFO [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportWithTargetName/1cc7f80304d71b006c0d2331db66bd4b/cf/9da6fdcaccca49769f281f2e5b4b73fb, entries=2, sequenceid=6, filesize=5.0 K 2023-07-17 13:11:11,100 INFO [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for f3a34c6818cb8118662075656e1d18d0 in 212ms, sequenceid=6, compaction requested=false 2023-07-17 13:11:11,100 INFO [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 1cc7f80304d71b006c0d2331db66bd4b in 216ms, sequenceid=6, compaction requested=false 2023-07-17 13:11:11,100 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-17 13:11:11,100 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-17 13:11:11,102 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f3a34c6818cb8118662075656e1d18d0: 2023-07-17 13:11:11,104 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1cc7f80304d71b006c0d2331db66bd4b: 2023-07-17 13:11:11,104 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689599468821.f3a34c6818cb8118662075656e1d18d0.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-17 13:11:11,104 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689599468821.1cc7f80304d71b006c0d2331db66bd4b.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-17 13:11:11,104 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:11:11,104 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:11:11,104 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportWithTargetName/f3a34c6818cb8118662075656e1d18d0/cf/7bc038db2e0b4dc1a45f79828b8e265a] hfiles 2023-07-17 13:11:11,104 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportWithTargetName/1cc7f80304d71b006c0d2331db66bd4b/cf/9da6fdcaccca49769f281f2e5b4b73fb] hfiles 2023-07-17 13:11:11,104 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportWithTargetName/f3a34c6818cb8118662075656e1d18d0/cf/7bc038db2e0b4dc1a45f79828b8e265a for snapshot=snaptb0-testExportWithTargetName 2023-07-17 13:11:11,104 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportWithTargetName/1cc7f80304d71b006c0d2331db66bd4b/cf/9da6fdcaccca49769f281f2e5b4b73fb for snapshot=snaptb0-testExportWithTargetName 2023-07-17 13:11:11,125 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:11:11,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-17 13:11:11,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-17 13:11:11,127 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 13:11:11,141 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689599468821.1cc7f80304d71b006c0d2331db66bd4b. completed. 2023-07-17 13:11:11,141 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689599468821.1cc7f80304d71b006c0d2331db66bd4b. 2023-07-17 13:11:11,142 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:11:11,142 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:11:11,142 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:11,142 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-17 13:11:11,142 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43575,1689599458131' in zk 2023-07-17 13:11:11,144 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:11,144 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-17 13:11:11,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:11,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:11,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:11,145 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:11,145 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689599468821.f3a34c6818cb8118662075656e1d18d0. completed. 2023-07-17 13:11:11,145 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-17 13:11:11,145 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689599468821.f3a34c6818cb8118662075656e1d18d0. 2023-07-17 13:11:11,146 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:11:11,146 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:11:11,146 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:11,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:11,147 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-17 13:11:11,147 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45883,1689599458200' in zk 2023-07-17 13:11:11,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:11,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 13:11:11,149 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:11,149 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-17 13:11:11,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:11,149 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:11,150 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-17 13:11:11,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:11,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:11,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:11,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 13:11:11,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:11,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:11,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:11,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43575,1689599458131': 2023-07-17 13:11:11,154 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43575,1689599458131' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-17 13:11:11,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:11,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:11,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:11,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:11,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:11,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 13:11:11,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:11,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:11,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:11,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:11,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 13:11:11,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:11,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:11,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:11,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45883,1689599458200': 2023-07-17 13:11:11,159 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45883,1689599458200' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-17 13:11:11,159 INFO [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-17 13:11:11,159 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 13:11:11,159 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 13:11:11,159 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-17 13:11:11,159 INFO [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 13:11:11,161 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 13:11:11,161 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 13:11:11,161 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 13:11:11,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 13:11:11,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:11,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:11,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 13:11:11,161 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:11,161 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 13:11:11,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 13:11:11,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 13:11:11,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 13:11:11,161 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:11,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 13:11:11,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 13:11:11,162 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:11,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:11,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:11,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:11,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:11,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:11,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:11,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:11,164 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:11,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 13:11:11,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 13:11:11,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 13:11:11,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 13:11:11,164 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:11,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:11,165 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:11,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 13:11:11,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:11,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:11,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:11,167 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:11,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:11,168 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:11,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 13:11:11,168 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:11,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:11,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:11,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:11,182 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:11,182 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:11,182 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 13:11:11,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:11,182 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:11,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:11,182 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:11,182 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:11,182 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 13:11:11,182 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:11,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:11,182 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:11,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:11,182 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:11,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:11,182 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-17 13:11:11,184 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:11,182 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:11,184 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 13:11:11,184 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:11,184 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:11,184 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 13:11:11,184 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 13:11:11,184 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-17 13:11:11,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:11,182 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:11,186 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-17 13:11:11,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:11,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:11,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:11,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:11,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:11,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:11,239 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-17 13:11:11,293 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-17 13:11:11,293 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-17 13:11:11,294 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-17 13:11:11,294 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689599470821Consolidate snapshot: snaptb0-testExportWithTargetName at 1689599471184 (+363 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1689599471184Writing data manifest for snaptb0-testExportWithTargetName at 1689599471203 (+19 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689599471227 (+24 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689599471293 (+66 ms) 2023-07-17 13:11:11,296 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-17 13:11:11,298 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 474 msec 2023-07-17 13:11:11,427 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:11:11,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-17 13:11:11,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 13:11:11,432 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599471432 2023-07-17 13:11:11,432 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37401, tgtDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599471432, rawTgtDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599471432, srcFsUri=hdfs://localhost:37401, srcDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b 2023-07-17 13:11:11,479 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37401, inputRoot=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b 2023-07-17 13:11:11,479 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-122493969_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599471432, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599471432/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-17 13:11:11,480 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37401, inputRoot=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b, snapshotDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-17 13:11:11,497 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599471432/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-17 13:11:11,600 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:11,601 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:11,601 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:11,602 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:12,590 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/hadoop-8988365136912338676.jar 2023-07-17 13:11:12,591 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:12,592 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:12,699 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/hadoop-9051382586705718630.jar 2023-07-17 13:11:12,700 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:12,700 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:12,701 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:12,702 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:12,702 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:12,703 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:12,703 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 13:11:12,704 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 13:11:12,705 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 13:11:12,706 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 13:11:12,706 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 13:11:12,707 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 13:11:12,708 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 13:11:12,708 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 13:11:12,709 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 13:11:12,709 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 13:11:12,715 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:11:12,715 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:11:12,716 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 13:11:12,716 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:11:12,717 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:11:12,718 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 13:11:12,718 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 13:11:14,465 WARN [Listener at jenkins-hbase4.apache.org/38153] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 13:11:14,471 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-17 13:11:14,482 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-17 13:11:14,880 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 13:11:15,069 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 13:11:15,069 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 13:11:15,512 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467386_0001_000001 (auth:SIMPLE) 2023-07-17 13:11:20,842 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467386_0001_000001 (auth:SIMPLE) 2023-07-17 13:11:23,117 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467386_0001_000001 (auth:SIMPLE) 2023-07-17 13:11:26,275 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467386_0001_000001 (auth:SIMPLE) 2023-07-17 13:11:27,476 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 13:11:27,478 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 13:11:27,487 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-17 13:11:27,487 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 13:11:27,488 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 13:11:27,488 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-233758021_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-17 13:11:27,489 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(367): hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-17 13:11:27,489 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(367): hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-17 13:11:27,489 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-233758021_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599471432/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599471432/.hbase-snapshot/testExportWithTargetName 2023-07-17 13:11:27,490 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(367): hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599471432/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-17 13:11:27,490 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(367): hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599471432/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-17 13:11:27,502 INFO [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-17 13:11:27,507 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-17 13:11:27,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-17 13:11:27,520 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599487520"}]},"ts":"1689599487520"} 2023-07-17 13:11:27,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-17 13:11:27,522 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-17 13:11:27,525 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-17 13:11:27,527 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1cc7f80304d71b006c0d2331db66bd4b, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f3a34c6818cb8118662075656e1d18d0, UNASSIGN}] 2023-07-17 13:11:27,529 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1cc7f80304d71b006c0d2331db66bd4b, UNASSIGN 2023-07-17 13:11:27,529 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f3a34c6818cb8118662075656e1d18d0, UNASSIGN 2023-07-17 13:11:27,530 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=1cc7f80304d71b006c0d2331db66bd4b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:27,531 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=f3a34c6818cb8118662075656e1d18d0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:27,531 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689599468821.1cc7f80304d71b006c0d2331db66bd4b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689599487530"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599487530"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599487530"}]},"ts":"1689599487530"} 2023-07-17 13:11:27,531 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689599468821.f3a34c6818cb8118662075656e1d18d0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689599487531"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599487531"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599487531"}]},"ts":"1689599487531"} 2023-07-17 13:11:27,533 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 1cc7f80304d71b006c0d2331db66bd4b, server=jenkins-hbase4.apache.org,43575,1689599458131}] 2023-07-17 13:11:27,534 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure f3a34c6818cb8118662075656e1d18d0, server=jenkins-hbase4.apache.org,45883,1689599458200}] 2023-07-17 13:11:27,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-17 13:11:27,693 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1cc7f80304d71b006c0d2331db66bd4b 2023-07-17 13:11:27,693 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f3a34c6818cb8118662075656e1d18d0 2023-07-17 13:11:27,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1cc7f80304d71b006c0d2331db66bd4b, disabling compactions & flushes 2023-07-17 13:11:27,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f3a34c6818cb8118662075656e1d18d0, disabling compactions & flushes 2023-07-17 13:11:27,694 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689599468821.1cc7f80304d71b006c0d2331db66bd4b. 2023-07-17 13:11:27,694 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689599468821.f3a34c6818cb8118662075656e1d18d0. 2023-07-17 13:11:27,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689599468821.1cc7f80304d71b006c0d2331db66bd4b. 2023-07-17 13:11:27,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689599468821.f3a34c6818cb8118662075656e1d18d0. 2023-07-17 13:11:27,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689599468821.1cc7f80304d71b006c0d2331db66bd4b. after waiting 0 ms 2023-07-17 13:11:27,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689599468821.1cc7f80304d71b006c0d2331db66bd4b. 2023-07-17 13:11:27,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689599468821.f3a34c6818cb8118662075656e1d18d0. after waiting 0 ms 2023-07-17 13:11:27,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689599468821.f3a34c6818cb8118662075656e1d18d0. 2023-07-17 13:11:27,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportWithTargetName/1cc7f80304d71b006c0d2331db66bd4b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 13:11:27,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:11:27,714 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689599468821.1cc7f80304d71b006c0d2331db66bd4b. 2023-07-17 13:11:27,714 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1cc7f80304d71b006c0d2331db66bd4b: 2023-07-17 13:11:27,714 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportWithTargetName/f3a34c6818cb8118662075656e1d18d0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 13:11:27,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:11:27,716 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689599468821.f3a34c6818cb8118662075656e1d18d0. 2023-07-17 13:11:27,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f3a34c6818cb8118662075656e1d18d0: 2023-07-17 13:11:27,717 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1cc7f80304d71b006c0d2331db66bd4b 2023-07-17 13:11:27,718 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=1cc7f80304d71b006c0d2331db66bd4b, regionState=CLOSED 2023-07-17 13:11:27,718 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689599468821.1cc7f80304d71b006c0d2331db66bd4b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689599487717"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599487717"}]},"ts":"1689599487717"} 2023-07-17 13:11:27,718 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f3a34c6818cb8118662075656e1d18d0 2023-07-17 13:11:27,719 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=f3a34c6818cb8118662075656e1d18d0, regionState=CLOSED 2023-07-17 13:11:27,719 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689599468821.f3a34c6818cb8118662075656e1d18d0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689599487719"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599487719"}]},"ts":"1689599487719"} 2023-07-17 13:11:27,724 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-17 13:11:27,724 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 1cc7f80304d71b006c0d2331db66bd4b, server=jenkins-hbase4.apache.org,43575,1689599458131 in 187 msec 2023-07-17 13:11:27,725 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-17 13:11:27,725 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure f3a34c6818cb8118662075656e1d18d0, server=jenkins-hbase4.apache.org,45883,1689599458200 in 188 msec 2023-07-17 13:11:27,726 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1cc7f80304d71b006c0d2331db66bd4b, UNASSIGN in 197 msec 2023-07-17 13:11:27,728 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-17 13:11:27,728 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f3a34c6818cb8118662075656e1d18d0, UNASSIGN in 198 msec 2023-07-17 13:11:27,729 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599487729"}]},"ts":"1689599487729"} 2023-07-17 13:11:27,730 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-17 13:11:27,732 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-17 13:11:27,735 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 223 msec 2023-07-17 13:11:27,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-17 13:11:27,824 INFO [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-17 13:11:27,829 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-17 13:11:27,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-17 13:11:27,839 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-17 13:11:27,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-17 13:11:27,841 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-17 13:11:27,843 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43575] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-17 13:11:27,846 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 13:11:27,846 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 13:11:27,846 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 13:11:27,846 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 13:11:27,847 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportWithTargetName/f3a34c6818cb8118662075656e1d18d0 2023-07-17 13:11:27,847 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportWithTargetName/1cc7f80304d71b006c0d2331db66bd4b 2023-07-17 13:11:27,848 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:11:27,848 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:11:27,848 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:11:27,848 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-17 13:11:27,849 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-17 13:11:27,849 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:11:27,849 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-17 13:11:27,849 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-17 13:11:27,849 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-17 13:11:27,849 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-17 13:11:27,849 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-17 13:11:27,849 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-17 13:11:27,851 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportWithTargetName/1cc7f80304d71b006c0d2331db66bd4b/cf, FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportWithTargetName/1cc7f80304d71b006c0d2331db66bd4b/recovered.edits] 2023-07-17 13:11:27,852 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportWithTargetName/f3a34c6818cb8118662075656e1d18d0/cf, FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportWithTargetName/f3a34c6818cb8118662075656e1d18d0/recovered.edits] 2023-07-17 13:11:27,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-17 13:11:27,859 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportWithTargetName/f3a34c6818cb8118662075656e1d18d0/cf/7bc038db2e0b4dc1a45f79828b8e265a to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/archive/data/default/testtb-testExportWithTargetName/f3a34c6818cb8118662075656e1d18d0/cf/7bc038db2e0b4dc1a45f79828b8e265a 2023-07-17 13:11:27,859 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportWithTargetName/1cc7f80304d71b006c0d2331db66bd4b/cf/9da6fdcaccca49769f281f2e5b4b73fb to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/archive/data/default/testtb-testExportWithTargetName/1cc7f80304d71b006c0d2331db66bd4b/cf/9da6fdcaccca49769f281f2e5b4b73fb 2023-07-17 13:11:27,863 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportWithTargetName/f3a34c6818cb8118662075656e1d18d0/recovered.edits/9.seqid to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/archive/data/default/testtb-testExportWithTargetName/f3a34c6818cb8118662075656e1d18d0/recovered.edits/9.seqid 2023-07-17 13:11:27,863 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportWithTargetName/1cc7f80304d71b006c0d2331db66bd4b/recovered.edits/9.seqid to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/archive/data/default/testtb-testExportWithTargetName/1cc7f80304d71b006c0d2331db66bd4b/recovered.edits/9.seqid 2023-07-17 13:11:27,864 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportWithTargetName/f3a34c6818cb8118662075656e1d18d0 2023-07-17 13:11:27,864 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportWithTargetName/1cc7f80304d71b006c0d2331db66bd4b 2023-07-17 13:11:27,865 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-17 13:11:27,867 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-17 13:11:27,888 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-17 13:11:27,891 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-17 13:11:27,893 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-17 13:11:27,893 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-17 13:11:27,893 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689599468821.1cc7f80304d71b006c0d2331db66bd4b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689599487893"}]},"ts":"9223372036854775807"} 2023-07-17 13:11:27,893 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689599468821.f3a34c6818cb8118662075656e1d18d0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689599487893"}]},"ts":"9223372036854775807"} 2023-07-17 13:11:27,895 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-17 13:11:27,895 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 1cc7f80304d71b006c0d2331db66bd4b, NAME => 'testtb-testExportWithTargetName,,1689599468821.1cc7f80304d71b006c0d2331db66bd4b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f3a34c6818cb8118662075656e1d18d0, NAME => 'testtb-testExportWithTargetName,1,1689599468821.f3a34c6818cb8118662075656e1d18d0.', STARTKEY => '1', ENDKEY => ''}] 2023-07-17 13:11:27,895 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-17 13:11:27,895 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689599487895"}]},"ts":"9223372036854775807"} 2023-07-17 13:11:27,897 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-17 13:11:27,899 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-17 13:11:27,901 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 69 msec 2023-07-17 13:11:27,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-17 13:11:27,953 INFO [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-17 13:11:27,971 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-17 13:11:27,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:27,977 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-17 13:11:27,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-17 13:11:28,011 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=756 (was 707) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/cluster_ebeb3e26-e5ee-6f23-45cc-cbe52345d6d9/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-233758021_17 at /127.0.0.1:60890 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/cluster_ebeb3e26-e5ee-6f23-45cc-cbe52345d6d9/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/cluster_ebeb3e26-e5ee-6f23-45cc-cbe52345d6d9/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/cluster_ebeb3e26-e5ee-6f23-45cc-cbe52345d6d9/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-233758021_17 at /127.0.0.1:44746 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_887506755_17 at /127.0.0.1:40638 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x12d0e02b-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/cluster_ebeb3e26-e5ee-6f23-45cc-cbe52345d6d9/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x12d0e02b-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1423048386_1 at /127.0.0.1:40604 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/cluster_ebeb3e26-e5ee-6f23-45cc-cbe52345d6d9/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x12d0e02b-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1423048386_1 at /127.0.0.1:60884 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2110913733) connection to jenkins-hbase4.apache.org/172.31.14.131:39817 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2110913733) connection to jenkins-hbase4.apache.org/172.31.14.131:45873 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1282 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x12d0e02b-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=921 (was 894) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=430 (was 389) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 174) - ProcessCount LEAK? -, AvailableMemoryMB=3392 (was 5029) 2023-07-17 13:11:28,011 WARN [Listener at jenkins-hbase4.apache.org/38153] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-07-17 13:11:28,032 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=756, OpenFileDescriptor=921, MaxFileDescriptor=60000, SystemLoadAverage=430, ProcessCount=181, AvailableMemoryMB=3391 2023-07-17 13:11:28,032 WARN [Listener at jenkins-hbase4.apache.org/38153] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-07-17 13:11:28,034 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-17 13:11:28,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-17 13:11:28,039 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 13:11:28,039 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-17 13:11:28,040 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 13:11:28,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-17 13:11:28,043 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemState/13f79f8d3c6f2881bf55e14b7e47073f 2023-07-17 13:11:28,043 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemState/e4dfef930abdcacc388b71da64dab345 2023-07-17 13:11:28,044 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemState/13f79f8d3c6f2881bf55e14b7e47073f empty. 2023-07-17 13:11:28,044 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemState/e4dfef930abdcacc388b71da64dab345 empty. 2023-07-17 13:11:28,044 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemState/13f79f8d3c6f2881bf55e14b7e47073f 2023-07-17 13:11:28,044 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemState/e4dfef930abdcacc388b71da64dab345 2023-07-17 13:11:28,044 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-17 13:11:28,058 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-17 13:11:28,059 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 13f79f8d3c6f2881bf55e14b7e47073f, NAME => 'testtb-testExportFileSystemState,,1689599488034.13f79f8d3c6f2881bf55e14b7e47073f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp 2023-07-17 13:11:28,060 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => e4dfef930abdcacc388b71da64dab345, NAME => 'testtb-testExportFileSystemState,1,1689599488034.e4dfef930abdcacc388b71da64dab345.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp 2023-07-17 13:11:28,081 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689599488034.e4dfef930abdcacc388b71da64dab345.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:11:28,082 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing e4dfef930abdcacc388b71da64dab345, disabling compactions & flushes 2023-07-17 13:11:28,082 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689599488034.e4dfef930abdcacc388b71da64dab345. 2023-07-17 13:11:28,082 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689599488034.e4dfef930abdcacc388b71da64dab345. 2023-07-17 13:11:28,082 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689599488034.e4dfef930abdcacc388b71da64dab345. after waiting 0 ms 2023-07-17 13:11:28,082 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689599488034.e4dfef930abdcacc388b71da64dab345. 2023-07-17 13:11:28,082 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689599488034.e4dfef930abdcacc388b71da64dab345. 2023-07-17 13:11:28,082 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for e4dfef930abdcacc388b71da64dab345: 2023-07-17 13:11:28,083 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689599488034.13f79f8d3c6f2881bf55e14b7e47073f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:11:28,084 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 13f79f8d3c6f2881bf55e14b7e47073f, disabling compactions & flushes 2023-07-17 13:11:28,084 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689599488034.13f79f8d3c6f2881bf55e14b7e47073f. 2023-07-17 13:11:28,084 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689599488034.13f79f8d3c6f2881bf55e14b7e47073f. 2023-07-17 13:11:28,084 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689599488034.13f79f8d3c6f2881bf55e14b7e47073f. after waiting 0 ms 2023-07-17 13:11:28,084 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689599488034.13f79f8d3c6f2881bf55e14b7e47073f. 2023-07-17 13:11:28,084 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689599488034.13f79f8d3c6f2881bf55e14b7e47073f. 2023-07-17 13:11:28,084 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 13f79f8d3c6f2881bf55e14b7e47073f: 2023-07-17 13:11:28,087 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 13:11:28,088 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689599488034.e4dfef930abdcacc388b71da64dab345.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689599488088"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599488088"}]},"ts":"1689599488088"} 2023-07-17 13:11:28,088 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689599488034.13f79f8d3c6f2881bf55e14b7e47073f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689599488088"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599488088"}]},"ts":"1689599488088"} 2023-07-17 13:11:28,091 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 13:11:28,092 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 13:11:28,092 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599488092"}]},"ts":"1689599488092"} 2023-07-17 13:11:28,094 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-17 13:11:28,097 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 13:11:28,098 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 13:11:28,099 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 13:11:28,099 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 13:11:28,099 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 13:11:28,099 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=13f79f8d3c6f2881bf55e14b7e47073f, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e4dfef930abdcacc388b71da64dab345, ASSIGN}] 2023-07-17 13:11:28,101 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e4dfef930abdcacc388b71da64dab345, ASSIGN 2023-07-17 13:11:28,102 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=13f79f8d3c6f2881bf55e14b7e47073f, ASSIGN 2023-07-17 13:11:28,103 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e4dfef930abdcacc388b71da64dab345, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45883,1689599458200; forceNewPlan=false, retain=false 2023-07-17 13:11:28,103 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=13f79f8d3c6f2881bf55e14b7e47073f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42601,1689599458269; forceNewPlan=false, retain=false 2023-07-17 13:11:28,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-17 13:11:28,253 INFO [jenkins-hbase4:44069] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 13:11:28,256 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=e4dfef930abdcacc388b71da64dab345, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:28,256 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=13f79f8d3c6f2881bf55e14b7e47073f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:28,256 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689599488034.e4dfef930abdcacc388b71da64dab345.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689599488256"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599488256"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599488256"}]},"ts":"1689599488256"} 2023-07-17 13:11:28,256 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689599488034.13f79f8d3c6f2881bf55e14b7e47073f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689599488256"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599488256"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599488256"}]},"ts":"1689599488256"} 2023-07-17 13:11:28,258 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure e4dfef930abdcacc388b71da64dab345, server=jenkins-hbase4.apache.org,45883,1689599458200}] 2023-07-17 13:11:28,259 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 13f79f8d3c6f2881bf55e14b7e47073f, server=jenkins-hbase4.apache.org,42601,1689599458269}] 2023-07-17 13:11:28,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-17 13:11:28,420 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689599488034.e4dfef930abdcacc388b71da64dab345. 2023-07-17 13:11:28,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e4dfef930abdcacc388b71da64dab345, NAME => 'testtb-testExportFileSystemState,1,1689599488034.e4dfef930abdcacc388b71da64dab345.', STARTKEY => '1', ENDKEY => ''} 2023-07-17 13:11:28,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689599488034.e4dfef930abdcacc388b71da64dab345. service=AccessControlService 2023-07-17 13:11:28,421 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 13:11:28,421 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689599488034.13f79f8d3c6f2881bf55e14b7e47073f. 2023-07-17 13:11:28,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState e4dfef930abdcacc388b71da64dab345 2023-07-17 13:11:28,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 13f79f8d3c6f2881bf55e14b7e47073f, NAME => 'testtb-testExportFileSystemState,,1689599488034.13f79f8d3c6f2881bf55e14b7e47073f.', STARTKEY => '', ENDKEY => '1'} 2023-07-17 13:11:28,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689599488034.e4dfef930abdcacc388b71da64dab345.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:11:28,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e4dfef930abdcacc388b71da64dab345 2023-07-17 13:11:28,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e4dfef930abdcacc388b71da64dab345 2023-07-17 13:11:28,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689599488034.13f79f8d3c6f2881bf55e14b7e47073f. service=AccessControlService 2023-07-17 13:11:28,422 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 13:11:28,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 13f79f8d3c6f2881bf55e14b7e47073f 2023-07-17 13:11:28,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689599488034.13f79f8d3c6f2881bf55e14b7e47073f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:11:28,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 13f79f8d3c6f2881bf55e14b7e47073f 2023-07-17 13:11:28,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 13f79f8d3c6f2881bf55e14b7e47073f 2023-07-17 13:11:28,423 INFO [StoreOpener-e4dfef930abdcacc388b71da64dab345-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e4dfef930abdcacc388b71da64dab345 2023-07-17 13:11:28,424 INFO [StoreOpener-13f79f8d3c6f2881bf55e14b7e47073f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 13f79f8d3c6f2881bf55e14b7e47073f 2023-07-17 13:11:28,425 DEBUG [StoreOpener-e4dfef930abdcacc388b71da64dab345-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemState/e4dfef930abdcacc388b71da64dab345/cf 2023-07-17 13:11:28,425 DEBUG [StoreOpener-e4dfef930abdcacc388b71da64dab345-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemState/e4dfef930abdcacc388b71da64dab345/cf 2023-07-17 13:11:28,425 INFO [StoreOpener-e4dfef930abdcacc388b71da64dab345-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e4dfef930abdcacc388b71da64dab345 columnFamilyName cf 2023-07-17 13:11:28,425 DEBUG [StoreOpener-13f79f8d3c6f2881bf55e14b7e47073f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemState/13f79f8d3c6f2881bf55e14b7e47073f/cf 2023-07-17 13:11:28,425 DEBUG [StoreOpener-13f79f8d3c6f2881bf55e14b7e47073f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemState/13f79f8d3c6f2881bf55e14b7e47073f/cf 2023-07-17 13:11:28,426 INFO [StoreOpener-e4dfef930abdcacc388b71da64dab345-1] regionserver.HStore(310): Store=e4dfef930abdcacc388b71da64dab345/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:11:28,426 INFO [StoreOpener-13f79f8d3c6f2881bf55e14b7e47073f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 13f79f8d3c6f2881bf55e14b7e47073f columnFamilyName cf 2023-07-17 13:11:28,428 INFO [StoreOpener-13f79f8d3c6f2881bf55e14b7e47073f-1] regionserver.HStore(310): Store=13f79f8d3c6f2881bf55e14b7e47073f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:11:28,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemState/e4dfef930abdcacc388b71da64dab345 2023-07-17 13:11:28,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemState/e4dfef930abdcacc388b71da64dab345 2023-07-17 13:11:28,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemState/13f79f8d3c6f2881bf55e14b7e47073f 2023-07-17 13:11:28,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemState/13f79f8d3c6f2881bf55e14b7e47073f 2023-07-17 13:11:28,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e4dfef930abdcacc388b71da64dab345 2023-07-17 13:11:28,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 13f79f8d3c6f2881bf55e14b7e47073f 2023-07-17 13:11:28,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemState/e4dfef930abdcacc388b71da64dab345/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 13:11:28,436 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e4dfef930abdcacc388b71da64dab345; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70863560, jitterRate=0.05594933032989502}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 13:11:28,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e4dfef930abdcacc388b71da64dab345: 2023-07-17 13:11:28,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemState/13f79f8d3c6f2881bf55e14b7e47073f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 13:11:28,437 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 13f79f8d3c6f2881bf55e14b7e47073f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63467505, jitterRate=-0.05426047742366791}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 13:11:28,437 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689599488034.e4dfef930abdcacc388b71da64dab345., pid=30, masterSystemTime=1689599488410 2023-07-17 13:11:28,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 13f79f8d3c6f2881bf55e14b7e47073f: 2023-07-17 13:11:28,439 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689599488034.13f79f8d3c6f2881bf55e14b7e47073f., pid=31, masterSystemTime=1689599488411 2023-07-17 13:11:28,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689599488034.e4dfef930abdcacc388b71da64dab345. 2023-07-17 13:11:28,440 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689599488034.e4dfef930abdcacc388b71da64dab345. 2023-07-17 13:11:28,440 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=e4dfef930abdcacc388b71da64dab345, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:28,441 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689599488034.e4dfef930abdcacc388b71da64dab345.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689599488440"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689599488440"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689599488440"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689599488440"}]},"ts":"1689599488440"} 2023-07-17 13:11:28,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689599488034.13f79f8d3c6f2881bf55e14b7e47073f. 2023-07-17 13:11:28,441 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689599488034.13f79f8d3c6f2881bf55e14b7e47073f. 2023-07-17 13:11:28,442 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=13f79f8d3c6f2881bf55e14b7e47073f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:28,444 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689599488034.13f79f8d3c6f2881bf55e14b7e47073f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689599488442"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689599488442"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689599488442"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689599488442"}]},"ts":"1689599488442"} 2023-07-17 13:11:28,448 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-17 13:11:28,448 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure e4dfef930abdcacc388b71da64dab345, server=jenkins-hbase4.apache.org,45883,1689599458200 in 187 msec 2023-07-17 13:11:28,450 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-17 13:11:28,452 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e4dfef930abdcacc388b71da64dab345, ASSIGN in 349 msec 2023-07-17 13:11:28,452 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 13f79f8d3c6f2881bf55e14b7e47073f, server=jenkins-hbase4.apache.org,42601,1689599458269 in 187 msec 2023-07-17 13:11:28,454 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-17 13:11:28,454 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=13f79f8d3c6f2881bf55e14b7e47073f, ASSIGN in 353 msec 2023-07-17 13:11:28,455 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 13:11:28,455 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599488455"}]},"ts":"1689599488455"} 2023-07-17 13:11:28,457 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-17 13:11:28,460 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 13:11:28,461 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-17 13:11:28,463 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43575] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-17 13:11:28,464 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:11:28,464 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:11:28,464 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:11:28,464 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:11:28,466 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 13:11:28,466 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 13:11:28,467 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 13:11:28,467 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 13:11:28,468 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 430 msec 2023-07-17 13:11:28,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-17 13:11:28,644 INFO [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-17 13:11:28,644 DEBUG [Listener at jenkins-hbase4.apache.org/38153] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-17 13:11:28,644 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 13:11:28,649 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-17 13:11:28,649 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 13:11:28,649 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-17 13:11:28,652 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 13:11:28,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689599488652 (current time:1689599488652). 2023-07-17 13:11:28,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 13:11:28,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(139): Connect 0x6b7dd73f to 127.0.0.1:56233 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:11:28,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e48307c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:11:28,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:28,665 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45238, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:11:28,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b7dd73f to 127.0.0.1:56233 2023-07-17 13:11:28,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:11:28,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(139): Connect 0x0f69e08b to 127.0.0.1:56233 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:11:28,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a281a76, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:11:28,684 DEBUG [hconnection-0x55bc009f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:28,685 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45252, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:11:28,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:28,693 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50866, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:11:28,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0f69e08b to 127.0.0.1:56233 2023-07-17 13:11:28,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:11:28,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-17 13:11:28,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 13:11:28,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 13:11:28,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-17 13:11:28,706 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-17 13:11:28,707 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689600088707 2023-07-17 13:11:28,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 13:11:28,707 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-17 13:11:28,709 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 13:11:28,709 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 13:11:28,711 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-17 13:11:28,712 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-17 13:11:28,714 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 14 msec 2023-07-17 13:11:28,715 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-17 13:11:28,716 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689600088716 2023-07-17 13:11:28,731 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:28,731 INFO [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-17 13:11:28,731 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:28,733 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-17 13:11:28,733 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-17 13:11:28,733 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:28,733 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:28,735 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:28,735 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:28,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:28,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:28,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:28,735 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:28,735 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:28,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:28,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:28,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:28,736 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:28,736 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:28,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:28,736 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:28,736 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 13:11:28,736 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:28,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:28,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:28,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-17 13:11:28,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:28,737 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:28,737 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:28,737 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-17 13:11:28,737 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:28,738 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-17 13:11:28,738 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:28,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-17 13:11:28,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:28,740 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-17 13:11:28,739 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-17 13:11:28,740 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-17 13:11:28,740 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45883,1689599458200' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-17 13:11:28,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-17 13:11:28,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:28,741 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-17 13:11:28,741 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:28,741 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-17 13:11:28,741 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:28,743 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-17 13:11:28,743 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:28,743 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-17 13:11:28,743 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-17 13:11:28,743 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:28,743 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:28,743 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42601,1689599458269' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-17 13:11:28,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:28,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:28,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:28,744 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:28,744 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-17 13:11:28,744 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-17 13:11:28,744 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43575,1689599458131' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-17 13:11:28,753 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:28,753 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:28,753 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:28,753 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:28,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:28,753 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:28,754 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:11:28,753 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:11:28,754 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:28,754 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:11:28,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:28,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:28,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:28,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:28,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:28,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:28,756 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45883,1689599458200' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-17 13:11:28,756 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e328e46[Count = 1] remaining members to acquire global barrier 2023-07-17 13:11:28,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:28,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:28,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:28,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:28,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:28,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:28,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:28,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:28,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:28,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:28,758 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42601,1689599458269' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-17 13:11:28,758 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e328e46[Count = 0] remaining members to acquire global barrier 2023-07-17 13:11:28,758 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-17 13:11:28,758 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:28,759 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:28,759 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:28,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:28,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:28,759 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:28,759 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-17 13:11:28,759 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:28,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:28,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:28,759 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:11:28,759 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:11:28,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:28,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:28,759 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-17 13:11:28,760 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-17 13:11:28,759 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:28,760 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 13:11:28,759 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689599488034.e4dfef930abdcacc388b71da64dab345. 2023-07-17 13:11:28,760 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-17 13:11:28,760 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689599488034.e4dfef930abdcacc388b71da64dab345. started... 2023-07-17 13:11:28,760 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43575,1689599458131' in zk 2023-07-17 13:11:28,760 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:11:28,761 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689599488034.13f79f8d3c6f2881bf55e14b7e47073f. 2023-07-17 13:11:28,761 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e4dfef930abdcacc388b71da64dab345: 2023-07-17 13:11:28,761 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689599488034.13f79f8d3c6f2881bf55e14b7e47073f. started... 2023-07-17 13:11:28,761 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:11:28,761 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689599488034.e4dfef930abdcacc388b71da64dab345.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:28,762 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 13f79f8d3c6f2881bf55e14b7e47073f: 2023-07-17 13:11:28,762 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:11:28,762 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 13:11:28,762 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689599488034.13f79f8d3c6f2881bf55e14b7e47073f.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:28,763 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:11:28,763 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 13:11:28,763 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-17 13:11:28,763 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:28,763 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-17 13:11:28,809 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:11:28,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 13:11:28,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 13:11:28,811 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 13:11:29,011 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:11:29,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 13:11:29,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 13:11:29,012 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 13:11:29,173 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689599488034.13f79f8d3c6f2881bf55e14b7e47073f. completed. 2023-07-17 13:11:29,173 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689599488034.13f79f8d3c6f2881bf55e14b7e47073f. 2023-07-17 13:11:29,174 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:11:29,174 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:11:29,174 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:29,174 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-17 13:11:29,174 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42601,1689599458269' in zk 2023-07-17 13:11:29,175 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689599488034.e4dfef930abdcacc388b71da64dab345. completed. 2023-07-17 13:11:29,175 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689599488034.e4dfef930abdcacc388b71da64dab345. 2023-07-17 13:11:29,175 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:11:29,175 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:11:29,175 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:29,175 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-17 13:11:29,175 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45883,1689599458200' in zk 2023-07-17 13:11:29,177 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:29,177 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-17 13:11:29,177 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:29,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:29,177 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-17 13:11:29,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:29,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:29,179 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:29,179 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-17 13:11:29,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:29,179 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:29,179 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-17 13:11:29,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:29,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:29,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:29,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:29,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:29,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:29,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:29,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:29,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,42601,1689599458269': 2023-07-17 13:11:29,184 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42601,1689599458269' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-17 13:11:29,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:29,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:29,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:29,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:29,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:29,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:29,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:29,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:29,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:29,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:29,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:29,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:29,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45883,1689599458200': 2023-07-17 13:11:29,188 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45883,1689599458200' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-17 13:11:29,188 INFO [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-17 13:11:29,188 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 13:11:29,188 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 13:11:29,189 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,189 INFO [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 13:11:29,190 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,190 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,190 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:29,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:29,190 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:29,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,190 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:29,190 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:29,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,191 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:29,191 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:29,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:29,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:29,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:29,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:29,192 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:29,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:29,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:29,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:29,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,192 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:29,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:29,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:29,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:29,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:29,195 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:29,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,195 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:29,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:29,196 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:29,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:29,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:29,199 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:29,199 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:29,199 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,199 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:29,199 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,199 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:29,199 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,199 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:29,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:29,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:29,199 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:29,199 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:29,199 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:29,199 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:29,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:29,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:29,200 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:29,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:29,199 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:29,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:29,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:29,201 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:29,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:29,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:29,202 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,202 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:29,202 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,202 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:29,202 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,202 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:29,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:29,224 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,249 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-17 13:11:29,249 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,249 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,249 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689599488707Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689599489199 (+492 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689599489199Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689599489205 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689599489218 (+13 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689599489249 (+31 ms) 2023-07-17 13:11:29,252 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-17 13:11:29,254 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 543 msec 2023-07-17 13:11:29,313 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:11:29,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 13:11:29,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 13:11:29,325 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689599488034.13f79f8d3c6f2881bf55e14b7e47073f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 13:11:29,327 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45883] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689599488034.e4dfef930abdcacc388b71da64dab345. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 13:11:29,332 DEBUG [Listener at jenkins-hbase4.apache.org/38153] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-17 13:11:29,332 DEBUG [Listener at jenkins-hbase4.apache.org/38153] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689599488034.13f79f8d3c6f2881bf55e14b7e47073f. 2023-07-17 13:11:29,334 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 13:11:29,346 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 13:11:29,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689599489346 (current time:1689599489346). 2023-07-17 13:11:29,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 13:11:29,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(139): Connect 0x0ee466f3 to 127.0.0.1:56233 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:11:29,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12e54f19, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:11:29,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:29,357 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45262, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:11:29,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0ee466f3 to 127.0.0.1:56233 2023-07-17 13:11:29,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:11:29,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(139): Connect 0x526bf04a to 127.0.0.1:56233 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:11:29,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4730d276, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:11:29,367 DEBUG [hconnection-0x1cca2896-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:29,369 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45268, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:11:29,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:29,375 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50868, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:11:29,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x526bf04a to 127.0.0.1:56233 2023-07-17 13:11:29,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:11:29,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-17 13:11:29,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 13:11:29,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 13:11:29,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-17 13:11:29,381 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-17 13:11:29,382 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689600089382 2023-07-17 13:11:29,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 13:11:29,382 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-17 13:11:29,383 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 13:11:29,383 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 13:11:29,384 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-17 13:11:29,384 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-17 13:11:29,385 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-17 13:11:29,386 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-17 13:11:29,387 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689600089387 2023-07-17 13:11:29,398 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-17 13:11:29,398 INFO [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-17 13:11:29,398 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:29,399 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-17 13:11:29,399 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-17 13:11:29,400 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,400 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,402 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:29,402 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:29,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:29,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:29,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:29,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:29,402 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:29,402 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:29,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:29,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:29,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,402 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:29,403 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:29,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,403 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,403 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,403 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:29,403 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 13:11:29,403 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-17 13:11:29,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-17 13:11:29,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-17 13:11:29,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,403 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-17 13:11:29,404 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-17 13:11:29,403 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-17 13:11:29,404 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-17 13:11:29,404 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-17 13:11:29,404 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:29,404 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-17 13:11:29,405 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-17 13:11:29,405 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-17 13:11:29,405 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:29,405 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-17 13:11:29,405 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-17 13:11:29,406 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:29,406 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-17 13:11:29,406 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-17 13:11:29,407 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-17 13:11:29,407 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42601,1689599458269' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-17 13:11:29,407 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-17 13:11:29,407 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-17 13:11:29,407 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45883,1689599458200' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-17 13:11:29,406 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43575,1689599458131' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-17 13:11:29,409 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,409 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:29,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:29,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:29,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:29,409 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,409 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:11:29,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:29,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:29,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 13:11:29,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:29,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:29,411 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45883,1689599458200' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-17 13:11:29,411 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22c7da39[Count = 1] remaining members to acquire global barrier 2023-07-17 13:11:29,412 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:29,412 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:29,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:29,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:29,413 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:29,413 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,413 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:11:29,413 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,413 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:11:29,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:29,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 13:11:29,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:29,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:29,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:29,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:29,415 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42601,1689599458269' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-17 13:11:29,415 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22c7da39[Count = 0] remaining members to acquire global barrier 2023-07-17 13:11:29,415 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-17 13:11:29,415 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,418 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,418 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,418 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,418 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:29,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,418 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-17 13:11:29,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,418 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-17 13:11:29,418 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-17 13:11:29,418 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43575,1689599458131' in zk 2023-07-17 13:11:29,418 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-17 13:11:29,418 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:29,418 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 13:11:29,418 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:11:29,418 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:11:29,418 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689599488034.e4dfef930abdcacc388b71da64dab345. 2023-07-17 13:11:29,419 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689599488034.13f79f8d3c6f2881bf55e14b7e47073f. 2023-07-17 13:11:29,419 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689599488034.e4dfef930abdcacc388b71da64dab345. started... 2023-07-17 13:11:29,418 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:11:29,419 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:11:29,419 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689599488034.13f79f8d3c6f2881bf55e14b7e47073f. started... 2023-07-17 13:11:29,419 INFO [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e4dfef930abdcacc388b71da64dab345 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-17 13:11:29,419 INFO [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 13f79f8d3c6f2881bf55e14b7e47073f 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-17 13:11:29,420 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-17 13:11:29,420 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:29,420 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-17 13:11:29,439 INFO [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemState/e4dfef930abdcacc388b71da64dab345/.tmp/cf/7cddd15e16eb4b72847c0dbaca7a6ef0 2023-07-17 13:11:29,439 INFO [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemState/13f79f8d3c6f2881bf55e14b7e47073f/.tmp/cf/b666fa8122bd470fbaf8d9415191575e 2023-07-17 13:11:29,451 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemState/13f79f8d3c6f2881bf55e14b7e47073f/.tmp/cf/b666fa8122bd470fbaf8d9415191575e as hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemState/13f79f8d3c6f2881bf55e14b7e47073f/cf/b666fa8122bd470fbaf8d9415191575e 2023-07-17 13:11:29,451 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemState/e4dfef930abdcacc388b71da64dab345/.tmp/cf/7cddd15e16eb4b72847c0dbaca7a6ef0 as hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemState/e4dfef930abdcacc388b71da64dab345/cf/7cddd15e16eb4b72847c0dbaca7a6ef0 2023-07-17 13:11:29,459 INFO [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemState/13f79f8d3c6f2881bf55e14b7e47073f/cf/b666fa8122bd470fbaf8d9415191575e, entries=4, sequenceid=6, filesize=5.1 K 2023-07-17 13:11:29,459 INFO [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemState/e4dfef930abdcacc388b71da64dab345/cf/7cddd15e16eb4b72847c0dbaca7a6ef0, entries=46, sequenceid=6, filesize=7.9 K 2023-07-17 13:11:29,464 INFO [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 13f79f8d3c6f2881bf55e14b7e47073f in 45ms, sequenceid=6, compaction requested=false 2023-07-17 13:11:29,464 INFO [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for e4dfef930abdcacc388b71da64dab345 in 45ms, sequenceid=6, compaction requested=false 2023-07-17 13:11:29,464 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-17 13:11:29,464 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-17 13:11:29,467 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e4dfef930abdcacc388b71da64dab345: 2023-07-17 13:11:29,467 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 13f79f8d3c6f2881bf55e14b7e47073f: 2023-07-17 13:11:29,467 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689599488034.e4dfef930abdcacc388b71da64dab345.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-17 13:11:29,467 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689599488034.13f79f8d3c6f2881bf55e14b7e47073f.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-17 13:11:29,467 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:11:29,467 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:11:29,467 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemState/e4dfef930abdcacc388b71da64dab345/cf/7cddd15e16eb4b72847c0dbaca7a6ef0] hfiles 2023-07-17 13:11:29,467 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemState/13f79f8d3c6f2881bf55e14b7e47073f/cf/b666fa8122bd470fbaf8d9415191575e] hfiles 2023-07-17 13:11:29,467 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemState/e4dfef930abdcacc388b71da64dab345/cf/7cddd15e16eb4b72847c0dbaca7a6ef0 for snapshot=snaptb0-testExportFileSystemState 2023-07-17 13:11:29,467 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemState/13f79f8d3c6f2881bf55e14b7e47073f/cf/b666fa8122bd470fbaf8d9415191575e for snapshot=snaptb0-testExportFileSystemState 2023-07-17 13:11:29,483 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:11:29,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 13:11:29,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 13:11:29,485 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 13:11:29,530 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689599488034.e4dfef930abdcacc388b71da64dab345. completed. 2023-07-17 13:11:29,530 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689599488034.e4dfef930abdcacc388b71da64dab345. 2023-07-17 13:11:29,530 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:11:29,530 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:11:29,530 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:29,530 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-17 13:11:29,530 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45883,1689599458200' in zk 2023-07-17 13:11:29,535 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689599488034.13f79f8d3c6f2881bf55e14b7e47073f. completed. 2023-07-17 13:11:29,535 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689599488034.13f79f8d3c6f2881bf55e14b7e47073f. 2023-07-17 13:11:29,535 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:11:29,536 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:11:29,536 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:29,536 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-17 13:11:29,536 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42601,1689599458269' in zk 2023-07-17 13:11:29,537 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-17 13:11:29,537 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:29,537 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:29,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:29,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:29,537 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-17 13:11:29,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:29,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:29,541 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-17 13:11:29,541 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:29,541 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-17 13:11:29,542 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:29,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:29,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 13:11:29,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:29,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:29,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:29,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:29,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 13:11:29,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:29,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:29,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:29,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45883,1689599458200': 2023-07-17 13:11:29,548 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45883,1689599458200' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-17 13:11:29,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:29,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:29,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:29,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:29,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:29,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 13:11:29,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:29,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:29,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:29,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:29,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 13:11:29,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:29,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:29,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:29,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,42601,1689599458269': 2023-07-17 13:11:29,553 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42601,1689599458269' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-17 13:11:29,554 INFO [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-17 13:11:29,554 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 13:11:29,554 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 13:11:29,554 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-17 13:11:29,554 INFO [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 13:11:29,556 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,556 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,556 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,556 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:29,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:29,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:29,556 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,556 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:29,556 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:29,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:29,557 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:29,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:29,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:29,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 13:11:29,557 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:29,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:29,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:29,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:29,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:29,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:29,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 13:11:29,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,559 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:29,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:29,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:29,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:29,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:29,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 13:11:29,565 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:29,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:29,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:29,566 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:29,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:29,576 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:29,580 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:29,580 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:29,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:29,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:29,580 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:29,580 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:29,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:29,580 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:29,580 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:29,581 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,581 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:29,581 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:29,581 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-17 13:11:29,583 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-17 13:11:29,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:29,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:29,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:29,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:29,581 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:29,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:29,581 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:29,584 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,584 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:29,584 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,584 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:29,584 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:29,584 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,584 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:29,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:29,584 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:29,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:29,629 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,668 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-17 13:11:29,668 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,668 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,668 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689599489382Consolidate snapshot: snaptb0-testExportFileSystemState at 1689599489583 (+201 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1689599489583Writing data manifest for snaptb0-testExportFileSystemState at 1689599489590 (+7 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689599489617 (+27 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689599489668 (+51 ms) 2023-07-17 13:11:29,671 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-17 13:11:29,674 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 289 msec 2023-07-17 13:11:29,685 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:11:29,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 13:11:29,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 13:11:29,692 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599489692 2023-07-17 13:11:29,692 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37401, tgtDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599489692, rawTgtDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599489692, srcFsUri=hdfs://localhost:37401, srcDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b 2023-07-17 13:11:29,742 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37401, inputRoot=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b 2023-07-17 13:11:29,742 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1783041280_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599489692, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599489692/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,742 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37401, inputRoot=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b, snapshotDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-17 13:11:29,768 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599489692/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-17 13:11:29,816 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:29,816 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:29,817 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:29,817 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:30,822 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/hadoop-4704522303323129342.jar 2023-07-17 13:11:30,822 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:30,823 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:30,900 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/hadoop-5226729503615819094.jar 2023-07-17 13:11:30,901 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:30,902 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:30,902 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:30,903 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:30,903 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:30,904 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:30,904 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 13:11:30,905 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 13:11:30,906 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 13:11:30,906 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 13:11:30,907 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 13:11:30,908 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 13:11:30,908 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 13:11:30,909 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 13:11:30,910 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 13:11:30,911 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 13:11:30,912 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:11:30,912 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:11:30,913 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 13:11:30,914 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:11:30,914 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:11:30,915 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 13:11:30,916 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 13:11:31,490 WARN [Listener at jenkins-hbase4.apache.org/38153] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 13:11:31,493 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-17 13:11:31,495 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-17 13:11:32,467 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 13:11:32,467 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 13:11:32,477 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467386_0001_000001 (auth:SIMPLE) 2023-07-17 13:11:32,719 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467386_0002_000001 (auth:SIMPLE) 2023-07-17 13:11:33,310 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 13:11:37,336 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467386_0002_000001 (auth:SIMPLE) 2023-07-17 13:11:39,569 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467386_0002_000001 (auth:SIMPLE) 2023-07-17 13:11:42,921 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467386_0002_000001 (auth:SIMPLE) 2023-07-17 13:11:44,817 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 13:11:44,820 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 13:11:44,830 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-17 13:11:44,830 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 13:11:44,831 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 13:11:44,831 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-233758021_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-17 13:11:44,831 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(367): hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-17 13:11:44,831 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(367): hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-17 13:11:44,831 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-233758021_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599489692/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599489692/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-17 13:11:44,832 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(367): hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599489692/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-17 13:11:44,832 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(367): hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599489692/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-17 13:11:44,839 INFO [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-17 13:11:44,839 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-17 13:11:44,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-17 13:11:44,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-17 13:11:44,845 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599504845"}]},"ts":"1689599504845"} 2023-07-17 13:11:44,846 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-17 13:11:44,848 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-17 13:11:44,849 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=13f79f8d3c6f2881bf55e14b7e47073f, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e4dfef930abdcacc388b71da64dab345, UNASSIGN}] 2023-07-17 13:11:44,851 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e4dfef930abdcacc388b71da64dab345, UNASSIGN 2023-07-17 13:11:44,851 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=13f79f8d3c6f2881bf55e14b7e47073f, UNASSIGN 2023-07-17 13:11:44,852 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=e4dfef930abdcacc388b71da64dab345, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:44,852 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=13f79f8d3c6f2881bf55e14b7e47073f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:44,852 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689599488034.e4dfef930abdcacc388b71da64dab345.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689599504852"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599504852"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599504852"}]},"ts":"1689599504852"} 2023-07-17 13:11:44,853 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689599488034.13f79f8d3c6f2881bf55e14b7e47073f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689599504852"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599504852"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599504852"}]},"ts":"1689599504852"} 2023-07-17 13:11:44,855 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure e4dfef930abdcacc388b71da64dab345, server=jenkins-hbase4.apache.org,45883,1689599458200}] 2023-07-17 13:11:44,855 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 13f79f8d3c6f2881bf55e14b7e47073f, server=jenkins-hbase4.apache.org,42601,1689599458269}] 2023-07-17 13:11:44,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-17 13:11:45,007 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e4dfef930abdcacc388b71da64dab345 2023-07-17 13:11:45,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e4dfef930abdcacc388b71da64dab345, disabling compactions & flushes 2023-07-17 13:11:45,007 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689599488034.e4dfef930abdcacc388b71da64dab345. 2023-07-17 13:11:45,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689599488034.e4dfef930abdcacc388b71da64dab345. 2023-07-17 13:11:45,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689599488034.e4dfef930abdcacc388b71da64dab345. after waiting 0 ms 2023-07-17 13:11:45,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689599488034.e4dfef930abdcacc388b71da64dab345. 2023-07-17 13:11:45,011 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 13f79f8d3c6f2881bf55e14b7e47073f 2023-07-17 13:11:45,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 13f79f8d3c6f2881bf55e14b7e47073f, disabling compactions & flushes 2023-07-17 13:11:45,012 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689599488034.13f79f8d3c6f2881bf55e14b7e47073f. 2023-07-17 13:11:45,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689599488034.13f79f8d3c6f2881bf55e14b7e47073f. 2023-07-17 13:11:45,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689599488034.13f79f8d3c6f2881bf55e14b7e47073f. after waiting 0 ms 2023-07-17 13:11:45,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689599488034.13f79f8d3c6f2881bf55e14b7e47073f. 2023-07-17 13:11:45,030 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemState/e4dfef930abdcacc388b71da64dab345/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 13:11:45,030 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemState/13f79f8d3c6f2881bf55e14b7e47073f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 13:11:45,030 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:11:45,031 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689599488034.e4dfef930abdcacc388b71da64dab345. 2023-07-17 13:11:45,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e4dfef930abdcacc388b71da64dab345: 2023-07-17 13:11:45,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:11:45,032 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689599488034.13f79f8d3c6f2881bf55e14b7e47073f. 2023-07-17 13:11:45,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 13f79f8d3c6f2881bf55e14b7e47073f: 2023-07-17 13:11:45,034 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e4dfef930abdcacc388b71da64dab345 2023-07-17 13:11:45,035 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=e4dfef930abdcacc388b71da64dab345, regionState=CLOSED 2023-07-17 13:11:45,035 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689599488034.e4dfef930abdcacc388b71da64dab345.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689599505034"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599505034"}]},"ts":"1689599505034"} 2023-07-17 13:11:45,035 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 13f79f8d3c6f2881bf55e14b7e47073f 2023-07-17 13:11:45,035 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=13f79f8d3c6f2881bf55e14b7e47073f, regionState=CLOSED 2023-07-17 13:11:45,035 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689599488034.13f79f8d3c6f2881bf55e14b7e47073f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689599505035"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599505035"}]},"ts":"1689599505035"} 2023-07-17 13:11:45,039 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-17 13:11:45,039 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure e4dfef930abdcacc388b71da64dab345, server=jenkins-hbase4.apache.org,45883,1689599458200 in 181 msec 2023-07-17 13:11:45,039 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-17 13:11:45,039 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 13f79f8d3c6f2881bf55e14b7e47073f, server=jenkins-hbase4.apache.org,42601,1689599458269 in 182 msec 2023-07-17 13:11:45,040 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e4dfef930abdcacc388b71da64dab345, UNASSIGN in 190 msec 2023-07-17 13:11:45,041 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-17 13:11:45,041 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=13f79f8d3c6f2881bf55e14b7e47073f, UNASSIGN in 190 msec 2023-07-17 13:11:45,042 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599505042"}]},"ts":"1689599505042"} 2023-07-17 13:11:45,043 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-17 13:11:45,045 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-17 13:11:45,047 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 205 msec 2023-07-17 13:11:45,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-17 13:11:45,146 INFO [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-17 13:11:45,147 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-17 13:11:45,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-17 13:11:45,151 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-17 13:11:45,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-17 13:11:45,152 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-17 13:11:45,153 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43575] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-17 13:11:45,157 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemState/13f79f8d3c6f2881bf55e14b7e47073f 2023-07-17 13:11:45,157 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemState/e4dfef930abdcacc388b71da64dab345 2023-07-17 13:11:45,159 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemState/e4dfef930abdcacc388b71da64dab345/cf, FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemState/e4dfef930abdcacc388b71da64dab345/recovered.edits] 2023-07-17 13:11:45,159 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemState/13f79f8d3c6f2881bf55e14b7e47073f/cf, FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemState/13f79f8d3c6f2881bf55e14b7e47073f/recovered.edits] 2023-07-17 13:11:45,161 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 13:11:45,161 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 13:11:45,161 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 13:11:45,161 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 13:11:45,162 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-17 13:11:45,162 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-17 13:11:45,162 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-17 13:11:45,162 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-17 13:11:45,163 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 13:11:45,163 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 13:11:45,163 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 13:11:45,163 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:11:45,163 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:11:45,163 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:11:45,164 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 13:11:45,164 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:11:45,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-17 13:11:45,165 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemState/e4dfef930abdcacc388b71da64dab345/cf/7cddd15e16eb4b72847c0dbaca7a6ef0 to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/archive/data/default/testtb-testExportFileSystemState/e4dfef930abdcacc388b71da64dab345/cf/7cddd15e16eb4b72847c0dbaca7a6ef0 2023-07-17 13:11:45,165 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemState/13f79f8d3c6f2881bf55e14b7e47073f/cf/b666fa8122bd470fbaf8d9415191575e to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/archive/data/default/testtb-testExportFileSystemState/13f79f8d3c6f2881bf55e14b7e47073f/cf/b666fa8122bd470fbaf8d9415191575e 2023-07-17 13:11:45,168 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemState/e4dfef930abdcacc388b71da64dab345/recovered.edits/9.seqid to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/archive/data/default/testtb-testExportFileSystemState/e4dfef930abdcacc388b71da64dab345/recovered.edits/9.seqid 2023-07-17 13:11:45,168 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemState/13f79f8d3c6f2881bf55e14b7e47073f/recovered.edits/9.seqid to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/archive/data/default/testtb-testExportFileSystemState/13f79f8d3c6f2881bf55e14b7e47073f/recovered.edits/9.seqid 2023-07-17 13:11:45,169 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemState/e4dfef930abdcacc388b71da64dab345 2023-07-17 13:11:45,169 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemState/13f79f8d3c6f2881bf55e14b7e47073f 2023-07-17 13:11:45,169 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-17 13:11:45,172 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-17 13:11:45,174 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-17 13:11:45,176 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-17 13:11:45,177 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-17 13:11:45,177 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-17 13:11:45,178 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689599488034.13f79f8d3c6f2881bf55e14b7e47073f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689599505177"}]},"ts":"9223372036854775807"} 2023-07-17 13:11:45,178 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689599488034.e4dfef930abdcacc388b71da64dab345.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689599505177"}]},"ts":"9223372036854775807"} 2023-07-17 13:11:45,180 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-17 13:11:45,180 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 13f79f8d3c6f2881bf55e14b7e47073f, NAME => 'testtb-testExportFileSystemState,,1689599488034.13f79f8d3c6f2881bf55e14b7e47073f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e4dfef930abdcacc388b71da64dab345, NAME => 'testtb-testExportFileSystemState,1,1689599488034.e4dfef930abdcacc388b71da64dab345.', STARTKEY => '1', ENDKEY => ''}] 2023-07-17 13:11:45,180 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-17 13:11:45,180 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689599505180"}]},"ts":"9223372036854775807"} 2023-07-17 13:11:45,182 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-17 13:11:45,184 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-17 13:11:45,186 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 36 msec 2023-07-17 13:11:45,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-17 13:11:45,266 INFO [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-17 13:11:45,273 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-17 13:11:45,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:45,277 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-17 13:11:45,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-17 13:11:45,303 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=765 (was 756) Potentially hanging thread: hconnection-0x12d0e02b-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-233758021_17 at /127.0.0.1:34394 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x12d0e02b-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x12d0e02b-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-233758021_17 at /127.0.0.1:35818 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1949 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (2110913733) connection to jenkins-hbase4.apache.org/172.31.14.131:37723 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2110913733) connection to jenkins-hbase4.apache.org/172.31.14.131:43347 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-233758021_17 at /127.0.0.1:54056 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x12d0e02b-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1419763701_1 at /127.0.0.1:54040 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=928 (was 921) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=433 (was 430) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 181), AvailableMemoryMB=3223 (was 3391) 2023-07-17 13:11:45,304 WARN [Listener at jenkins-hbase4.apache.org/38153] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-17 13:11:45,324 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=765, OpenFileDescriptor=928, MaxFileDescriptor=60000, SystemLoadAverage=433, ProcessCount=181, AvailableMemoryMB=3223 2023-07-17 13:11:45,325 WARN [Listener at jenkins-hbase4.apache.org/38153] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-17 13:11:45,327 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-17 13:11:45,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-17 13:11:45,331 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 13:11:45,331 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-17 13:11:45,332 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 13:11:45,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-17 13:11:45,335 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testConsecutiveExports/0e16186fcb61e65fda12019cddd62011 2023-07-17 13:11:45,335 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testConsecutiveExports/7a9c7f3ac4bf4eb4ce7925d3ce66e6c7 2023-07-17 13:11:45,335 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testConsecutiveExports/0e16186fcb61e65fda12019cddd62011 empty. 2023-07-17 13:11:45,335 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testConsecutiveExports/7a9c7f3ac4bf4eb4ce7925d3ce66e6c7 empty. 2023-07-17 13:11:45,336 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testConsecutiveExports/0e16186fcb61e65fda12019cddd62011 2023-07-17 13:11:45,336 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testConsecutiveExports/7a9c7f3ac4bf4eb4ce7925d3ce66e6c7 2023-07-17 13:11:45,336 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-17 13:11:45,364 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-17 13:11:45,366 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 7a9c7f3ac4bf4eb4ce7925d3ce66e6c7, NAME => 'testtb-testConsecutiveExports,1,1689599505326.7a9c7f3ac4bf4eb4ce7925d3ce66e6c7.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp 2023-07-17 13:11:45,366 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0e16186fcb61e65fda12019cddd62011, NAME => 'testtb-testConsecutiveExports,,1689599505326.0e16186fcb61e65fda12019cddd62011.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp 2023-07-17 13:11:45,401 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689599505326.7a9c7f3ac4bf4eb4ce7925d3ce66e6c7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:11:45,402 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 7a9c7f3ac4bf4eb4ce7925d3ce66e6c7, disabling compactions & flushes 2023-07-17 13:11:45,402 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689599505326.7a9c7f3ac4bf4eb4ce7925d3ce66e6c7. 2023-07-17 13:11:45,402 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689599505326.7a9c7f3ac4bf4eb4ce7925d3ce66e6c7. 2023-07-17 13:11:45,402 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689599505326.7a9c7f3ac4bf4eb4ce7925d3ce66e6c7. after waiting 0 ms 2023-07-17 13:11:45,402 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689599505326.7a9c7f3ac4bf4eb4ce7925d3ce66e6c7. 2023-07-17 13:11:45,402 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689599505326.7a9c7f3ac4bf4eb4ce7925d3ce66e6c7. 2023-07-17 13:11:45,402 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 7a9c7f3ac4bf4eb4ce7925d3ce66e6c7: 2023-07-17 13:11:45,408 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689599505326.0e16186fcb61e65fda12019cddd62011.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:11:45,408 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 0e16186fcb61e65fda12019cddd62011, disabling compactions & flushes 2023-07-17 13:11:45,408 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689599505326.0e16186fcb61e65fda12019cddd62011. 2023-07-17 13:11:45,408 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689599505326.0e16186fcb61e65fda12019cddd62011. 2023-07-17 13:11:45,408 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689599505326.0e16186fcb61e65fda12019cddd62011. after waiting 0 ms 2023-07-17 13:11:45,408 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689599505326.0e16186fcb61e65fda12019cddd62011. 2023-07-17 13:11:45,408 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689599505326.0e16186fcb61e65fda12019cddd62011. 2023-07-17 13:11:45,408 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 0e16186fcb61e65fda12019cddd62011: 2023-07-17 13:11:45,414 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 13:11:45,415 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689599505326.7a9c7f3ac4bf4eb4ce7925d3ce66e6c7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689599505415"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599505415"}]},"ts":"1689599505415"} 2023-07-17 13:11:45,415 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689599505326.0e16186fcb61e65fda12019cddd62011.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689599505415"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599505415"}]},"ts":"1689599505415"} 2023-07-17 13:11:45,417 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 13:11:45,419 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 13:11:45,419 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599505419"}]},"ts":"1689599505419"} 2023-07-17 13:11:45,420 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-17 13:11:45,424 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 13:11:45,425 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 13:11:45,425 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 13:11:45,425 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 13:11:45,425 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 13:11:45,426 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0e16186fcb61e65fda12019cddd62011, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7a9c7f3ac4bf4eb4ce7925d3ce66e6c7, ASSIGN}] 2023-07-17 13:11:45,428 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7a9c7f3ac4bf4eb4ce7925d3ce66e6c7, ASSIGN 2023-07-17 13:11:45,428 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0e16186fcb61e65fda12019cddd62011, ASSIGN 2023-07-17 13:11:45,429 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7a9c7f3ac4bf4eb4ce7925d3ce66e6c7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43575,1689599458131; forceNewPlan=false, retain=false 2023-07-17 13:11:45,429 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0e16186fcb61e65fda12019cddd62011, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45883,1689599458200; forceNewPlan=false, retain=false 2023-07-17 13:11:45,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-17 13:11:45,580 INFO [jenkins-hbase4:44069] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 13:11:45,583 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=7a9c7f3ac4bf4eb4ce7925d3ce66e6c7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:45,583 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=0e16186fcb61e65fda12019cddd62011, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:45,583 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689599505326.7a9c7f3ac4bf4eb4ce7925d3ce66e6c7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689599505583"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599505583"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599505583"}]},"ts":"1689599505583"} 2023-07-17 13:11:45,583 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689599505326.0e16186fcb61e65fda12019cddd62011.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689599505583"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599505583"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599505583"}]},"ts":"1689599505583"} 2023-07-17 13:11:45,586 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 7a9c7f3ac4bf4eb4ce7925d3ce66e6c7, server=jenkins-hbase4.apache.org,43575,1689599458131}] 2023-07-17 13:11:45,587 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 0e16186fcb61e65fda12019cddd62011, server=jenkins-hbase4.apache.org,45883,1689599458200}] 2023-07-17 13:11:45,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-17 13:11:45,745 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689599505326.0e16186fcb61e65fda12019cddd62011. 2023-07-17 13:11:45,745 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689599505326.7a9c7f3ac4bf4eb4ce7925d3ce66e6c7. 2023-07-17 13:11:45,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0e16186fcb61e65fda12019cddd62011, NAME => 'testtb-testConsecutiveExports,,1689599505326.0e16186fcb61e65fda12019cddd62011.', STARTKEY => '', ENDKEY => '1'} 2023-07-17 13:11:45,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7a9c7f3ac4bf4eb4ce7925d3ce66e6c7, NAME => 'testtb-testConsecutiveExports,1,1689599505326.7a9c7f3ac4bf4eb4ce7925d3ce66e6c7.', STARTKEY => '1', ENDKEY => ''} 2023-07-17 13:11:45,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689599505326.7a9c7f3ac4bf4eb4ce7925d3ce66e6c7. service=AccessControlService 2023-07-17 13:11:45,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689599505326.0e16186fcb61e65fda12019cddd62011. service=AccessControlService 2023-07-17 13:11:45,746 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 13:11:45,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 7a9c7f3ac4bf4eb4ce7925d3ce66e6c7 2023-07-17 13:11:45,746 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 13:11:45,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689599505326.7a9c7f3ac4bf4eb4ce7925d3ce66e6c7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:11:45,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7a9c7f3ac4bf4eb4ce7925d3ce66e6c7 2023-07-17 13:11:45,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 0e16186fcb61e65fda12019cddd62011 2023-07-17 13:11:45,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7a9c7f3ac4bf4eb4ce7925d3ce66e6c7 2023-07-17 13:11:45,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689599505326.0e16186fcb61e65fda12019cddd62011.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:11:45,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0e16186fcb61e65fda12019cddd62011 2023-07-17 13:11:45,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0e16186fcb61e65fda12019cddd62011 2023-07-17 13:11:45,748 INFO [StoreOpener-7a9c7f3ac4bf4eb4ce7925d3ce66e6c7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7a9c7f3ac4bf4eb4ce7925d3ce66e6c7 2023-07-17 13:11:45,748 INFO [StoreOpener-0e16186fcb61e65fda12019cddd62011-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0e16186fcb61e65fda12019cddd62011 2023-07-17 13:11:45,750 DEBUG [StoreOpener-7a9c7f3ac4bf4eb4ce7925d3ce66e6c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testConsecutiveExports/7a9c7f3ac4bf4eb4ce7925d3ce66e6c7/cf 2023-07-17 13:11:45,750 DEBUG [StoreOpener-7a9c7f3ac4bf4eb4ce7925d3ce66e6c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testConsecutiveExports/7a9c7f3ac4bf4eb4ce7925d3ce66e6c7/cf 2023-07-17 13:11:45,750 DEBUG [StoreOpener-0e16186fcb61e65fda12019cddd62011-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testConsecutiveExports/0e16186fcb61e65fda12019cddd62011/cf 2023-07-17 13:11:45,750 DEBUG [StoreOpener-0e16186fcb61e65fda12019cddd62011-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testConsecutiveExports/0e16186fcb61e65fda12019cddd62011/cf 2023-07-17 13:11:45,750 INFO [StoreOpener-7a9c7f3ac4bf4eb4ce7925d3ce66e6c7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7a9c7f3ac4bf4eb4ce7925d3ce66e6c7 columnFamilyName cf 2023-07-17 13:11:45,750 INFO [StoreOpener-0e16186fcb61e65fda12019cddd62011-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0e16186fcb61e65fda12019cddd62011 columnFamilyName cf 2023-07-17 13:11:45,751 INFO [StoreOpener-7a9c7f3ac4bf4eb4ce7925d3ce66e6c7-1] regionserver.HStore(310): Store=7a9c7f3ac4bf4eb4ce7925d3ce66e6c7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:11:45,751 INFO [StoreOpener-0e16186fcb61e65fda12019cddd62011-1] regionserver.HStore(310): Store=0e16186fcb61e65fda12019cddd62011/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:11:45,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testConsecutiveExports/7a9c7f3ac4bf4eb4ce7925d3ce66e6c7 2023-07-17 13:11:45,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testConsecutiveExports/0e16186fcb61e65fda12019cddd62011 2023-07-17 13:11:45,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testConsecutiveExports/7a9c7f3ac4bf4eb4ce7925d3ce66e6c7 2023-07-17 13:11:45,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testConsecutiveExports/0e16186fcb61e65fda12019cddd62011 2023-07-17 13:11:45,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0e16186fcb61e65fda12019cddd62011 2023-07-17 13:11:45,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7a9c7f3ac4bf4eb4ce7925d3ce66e6c7 2023-07-17 13:11:45,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testConsecutiveExports/0e16186fcb61e65fda12019cddd62011/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 13:11:45,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testConsecutiveExports/7a9c7f3ac4bf4eb4ce7925d3ce66e6c7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 13:11:45,758 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0e16186fcb61e65fda12019cddd62011; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62549901, jitterRate=-0.06793384253978729}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 13:11:45,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0e16186fcb61e65fda12019cddd62011: 2023-07-17 13:11:45,758 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7a9c7f3ac4bf4eb4ce7925d3ce66e6c7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63575001, jitterRate=-0.05265866219997406}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 13:11:45,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7a9c7f3ac4bf4eb4ce7925d3ce66e6c7: 2023-07-17 13:11:45,759 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689599505326.0e16186fcb61e65fda12019cddd62011., pid=46, masterSystemTime=1689599505739 2023-07-17 13:11:45,759 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689599505326.7a9c7f3ac4bf4eb4ce7925d3ce66e6c7., pid=45, masterSystemTime=1689599505739 2023-07-17 13:11:45,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689599505326.0e16186fcb61e65fda12019cddd62011. 2023-07-17 13:11:45,761 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689599505326.0e16186fcb61e65fda12019cddd62011. 2023-07-17 13:11:45,761 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=0e16186fcb61e65fda12019cddd62011, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:45,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689599505326.7a9c7f3ac4bf4eb4ce7925d3ce66e6c7. 2023-07-17 13:11:45,762 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689599505326.0e16186fcb61e65fda12019cddd62011.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689599505761"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689599505761"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689599505761"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689599505761"}]},"ts":"1689599505761"} 2023-07-17 13:11:45,762 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689599505326.7a9c7f3ac4bf4eb4ce7925d3ce66e6c7. 2023-07-17 13:11:45,763 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=7a9c7f3ac4bf4eb4ce7925d3ce66e6c7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:45,763 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689599505326.7a9c7f3ac4bf4eb4ce7925d3ce66e6c7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689599505762"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689599505762"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689599505762"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689599505762"}]},"ts":"1689599505762"} 2023-07-17 13:11:45,768 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-17 13:11:45,768 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 0e16186fcb61e65fda12019cddd62011, server=jenkins-hbase4.apache.org,45883,1689599458200 in 178 msec 2023-07-17 13:11:45,770 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-17 13:11:45,770 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0e16186fcb61e65fda12019cddd62011, ASSIGN in 342 msec 2023-07-17 13:11:45,770 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 7a9c7f3ac4bf4eb4ce7925d3ce66e6c7, server=jenkins-hbase4.apache.org,43575,1689599458131 in 181 msec 2023-07-17 13:11:45,772 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-17 13:11:45,772 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7a9c7f3ac4bf4eb4ce7925d3ce66e6c7, ASSIGN in 344 msec 2023-07-17 13:11:45,773 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 13:11:45,773 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599505773"}]},"ts":"1689599505773"} 2023-07-17 13:11:45,774 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-17 13:11:45,777 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 13:11:45,777 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-17 13:11:45,779 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43575] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-17 13:11:45,781 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:11:45,781 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:11:45,781 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:11:45,781 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:11:45,783 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-17 13:11:45,783 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-17 13:11:45,783 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-17 13:11:45,783 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-17 13:11:45,785 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 456 msec 2023-07-17 13:11:45,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-17 13:11:45,936 INFO [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-17 13:11:45,936 DEBUG [Listener at jenkins-hbase4.apache.org/38153] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-17 13:11:45,936 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 13:11:45,940 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-17 13:11:45,941 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 13:11:45,941 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-17 13:11:45,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-17 13:11:45,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689599505944 (current time:1689599505944). 2023-07-17 13:11:45,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 13:11:45,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(139): Connect 0x69656f49 to 127.0.0.1:56233 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:11:45,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@fee150f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:11:45,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:45,966 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36192, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:11:45,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x69656f49 to 127.0.0.1:56233 2023-07-17 13:11:45,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:11:45,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(139): Connect 0x552cb5b6 to 127.0.0.1:56233 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:11:45,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1771877d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:11:45,982 DEBUG [hconnection-0x68c8aef1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:45,985 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36200, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:11:45,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:45,991 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33012, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:11:45,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x552cb5b6 to 127.0.0.1:56233 2023-07-17 13:11:45,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:11:45,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-17 13:11:45,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 13:11:45,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-17 13:11:45,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-17 13:11:45,997 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-17 13:11:45,998 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689600105998 2023-07-17 13:11:45,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-17 13:11:45,998 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-17 13:11:46,000 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 13:11:46,000 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 13:11:46,000 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-17 13:11:46,005 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-17 13:11:46,006 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 10 msec 2023-07-17 13:11:46,007 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-17 13:11:46,008 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689600106008 2023-07-17 13:11:46,020 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,020 INFO [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-17 13:11:46,020 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:46,022 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-17 13:11:46,022 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-17 13:11:46,022 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,022 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,024 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:46,024 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:46,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:46,024 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:46,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:46,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:46,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:46,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,025 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:46,025 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:46,025 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:46,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:46,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:46,025 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,025 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:46,025 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 13:11:46,025 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-17 13:11:46,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-17 13:11:46,026 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-17 13:11:46,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,026 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,026 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-17 13:11:46,026 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,026 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-17 13:11:46,026 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:46,026 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,028 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-17 13:11:46,028 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-17 13:11:46,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-17 13:11:46,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,028 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:46,028 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-17 13:11:46,029 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-17 13:11:46,029 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-17 13:11:46,028 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-17 13:11:46,029 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42601,1689599458269' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-17 13:11:46,029 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43575,1689599458131' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-17 13:11:46,030 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,030 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-17 13:11:46,030 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:46,034 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-17 13:11:46,034 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-17 13:11:46,034 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45883,1689599458200' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-17 13:11:46,035 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:46,035 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,035 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:46,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:46,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:46,037 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,037 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:46,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:46,037 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:11:46,037 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,037 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,038 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:11:46,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:46,038 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,038 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:11:46,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:46,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:46,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:46,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:46,040 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43575,1689599458131' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-17 13:11:46,040 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a7f416f[Count = 1] remaining members to acquire global barrier 2023-07-17 13:11:46,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:46,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:46,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:46,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:46,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:46,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:46,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:46,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:46,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:46,043 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45883,1689599458200' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-17 13:11:46,043 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a7f416f[Count = 0] remaining members to acquire global barrier 2023-07-17 13:11:46,043 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-17 13:11:46,043 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,045 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,045 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,045 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,045 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:46,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,045 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-17 13:11:46,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,045 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-17 13:11:46,045 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-17 13:11:46,045 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42601,1689599458269' in zk 2023-07-17 13:11:46,045 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:46,045 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 13:11:46,045 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:11:46,045 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:11:46,045 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-17 13:11:46,045 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689599505326.7a9c7f3ac4bf4eb4ce7925d3ce66e6c7. 2023-07-17 13:11:46,046 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689599505326.7a9c7f3ac4bf4eb4ce7925d3ce66e6c7. started... 2023-07-17 13:11:46,046 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:11:46,046 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:11:46,046 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689599505326.0e16186fcb61e65fda12019cddd62011. 2023-07-17 13:11:46,046 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689599505326.0e16186fcb61e65fda12019cddd62011. started... 2023-07-17 13:11:46,047 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7a9c7f3ac4bf4eb4ce7925d3ce66e6c7: 2023-07-17 13:11:46,049 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0e16186fcb61e65fda12019cddd62011: 2023-07-17 13:11:46,049 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689599505326.7a9c7f3ac4bf4eb4ce7925d3ce66e6c7.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,049 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:11:46,049 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 13:11:46,049 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689599505326.0e16186fcb61e65fda12019cddd62011.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,050 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:11:46,050 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 13:11:46,051 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-17 13:11:46,051 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:46,051 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-17 13:11:46,072 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689599505326.0e16186fcb61e65fda12019cddd62011. completed. 2023-07-17 13:11:46,072 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689599505326.0e16186fcb61e65fda12019cddd62011. 2023-07-17 13:11:46,074 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:11:46,074 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:11:46,074 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:46,074 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-17 13:11:46,074 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45883,1689599458200' in zk 2023-07-17 13:11:46,074 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689599505326.7a9c7f3ac4bf4eb4ce7925d3ce66e6c7. completed. 2023-07-17 13:11:46,074 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689599505326.7a9c7f3ac4bf4eb4ce7925d3ce66e6c7. 2023-07-17 13:11:46,074 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:11:46,074 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:11:46,074 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:46,074 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-17 13:11:46,074 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43575,1689599458131' in zk 2023-07-17 13:11:46,076 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-17 13:11:46,076 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:46,076 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:46,076 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-17 13:11:46,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:46,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:46,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:46,077 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:46,077 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-17 13:11:46,077 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:46,077 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-17 13:11:46,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:46,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:46,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:46,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:46,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:46,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:46,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:46,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:46,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:46,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,45883,1689599458200': 2023-07-17 13:11:46,083 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45883,1689599458200' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-17 13:11:46,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:46,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:46,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:46,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:46,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:46,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:46,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:46,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:46,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:46,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:46,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:46,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:46,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43575,1689599458131': 2023-07-17 13:11:46,087 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43575,1689599458131' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-17 13:11:46,087 INFO [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-17 13:11:46,087 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 13:11:46,087 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 13:11:46,087 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,087 INFO [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 13:11:46,095 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,095 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:46,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:46,096 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:46,096 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,095 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,096 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:46,096 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:46,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:46,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:46,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:46,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:46,097 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:46,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,098 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:46,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:46,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:46,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:46,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:46,100 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:46,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,100 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:11:46,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-17 13:11:46,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:46,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-17 13:11:46,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:46,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:46,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:46,104 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:46,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,104 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 13:11:46,105 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:46,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:46,106 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:46,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:46,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:46,110 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:46,110 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,110 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:46,110 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:46,110 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:46,110 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:46,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:46,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:46,110 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:46,111 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,111 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,110 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:46,110 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:46,111 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,111 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:46,111 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,111 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:46,111 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:46,111 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,111 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:46,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:46,112 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:46,111 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:46,111 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:46,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:46,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:46,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:46,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:46,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:46,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:46,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:46,133 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,157 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-17 13:11:46,157 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,158 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,158 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689599505998Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689599506111 (+113 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689599506111Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689599506117 (+6 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689599506126 (+9 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689599506157 (+31 ms) 2023-07-17 13:11:46,161 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-17 13:11:46,162 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 161 msec 2023-07-17 13:11:46,304 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:11:46,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-17 13:11:46,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 13:11:46,314 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45883] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689599505326.0e16186fcb61e65fda12019cddd62011. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 13:11:46,316 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43575] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689599505326.7a9c7f3ac4bf4eb4ce7925d3ce66e6c7. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 13:11:46,320 DEBUG [Listener at jenkins-hbase4.apache.org/38153] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-17 13:11:46,320 DEBUG [Listener at jenkins-hbase4.apache.org/38153] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689599505326.0e16186fcb61e65fda12019cddd62011. 2023-07-17 13:11:46,322 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 13:11:46,333 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-17 13:11:46,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689599506333 (current time:1689599506333). 2023-07-17 13:11:46,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 13:11:46,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(139): Connect 0x42289e4c to 127.0.0.1:56233 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:11:46,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11691bf5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:11:46,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:46,350 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36202, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:11:46,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x42289e4c to 127.0.0.1:56233 2023-07-17 13:11:46,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:11:46,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(139): Connect 0x280c0652 to 127.0.0.1:56233 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:11:46,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e5037e1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:11:46,360 DEBUG [hconnection-0x773f376d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:46,361 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36212, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:11:46,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:46,366 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33016, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:11:46,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x280c0652 to 127.0.0.1:56233 2023-07-17 13:11:46,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:11:46,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-17 13:11:46,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 13:11:46,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-17 13:11:46,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-17 13:11:46,371 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-17 13:11:46,372 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689600106372 2023-07-17 13:11:46,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-17 13:11:46,372 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-17 13:11:46,373 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 13:11:46,373 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 13:11:46,374 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-17 13:11:46,375 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-17 13:11:46,376 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 4 msec 2023-07-17 13:11:46,376 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-17 13:11:46,377 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689600106377 2023-07-17 13:11:46,386 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-17 13:11:46,386 INFO [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-17 13:11:46,386 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:46,387 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-17 13:11:46,387 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-17 13:11:46,387 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,387 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,389 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:46,389 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:46,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:46,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:46,389 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:46,389 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:46,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:46,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:46,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:46,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:46,389 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:46,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,389 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:46,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,390 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,390 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:46,390 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 13:11:46,390 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,390 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-17 13:11:46,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-17 13:11:46,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,391 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-17 13:11:46,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-17 13:11:46,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,391 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-17 13:11:46,391 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-17 13:11:46,391 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-17 13:11:46,391 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-17 13:11:46,391 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:46,391 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-17 13:11:46,391 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-17 13:11:46,392 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-17 13:11:46,392 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-17 13:11:46,392 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-17 13:11:46,392 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:46,392 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-17 13:11:46,392 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43575,1689599458131' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-17 13:11:46,392 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:46,393 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-17 13:11:46,394 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-17 13:11:46,394 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-17 13:11:46,394 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-17 13:11:46,394 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45883,1689599458200' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-17 13:11:46,394 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42601,1689599458269' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-17 13:11:46,395 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:46,395 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:46,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:46,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:46,398 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:46,399 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,399 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:46,399 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:11:46,407 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,407 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,407 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:11:46,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:46,408 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,408 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:11:46,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 13:11:46,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:46,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:46,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:46,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:46,409 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43575,1689599458131' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-17 13:11:46,409 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1506ad88[Count = 1] remaining members to acquire global barrier 2023-07-17 13:11:46,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:46,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:46,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:46,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:46,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:46,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 13:11:46,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:46,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:46,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:46,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:46,411 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45883,1689599458200' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-17 13:11:46,411 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1506ad88[Count = 0] remaining members to acquire global barrier 2023-07-17 13:11:46,411 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-17 13:11:46,412 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,413 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,413 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,413 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:46,413 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,413 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-17 13:11:46,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,413 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-17 13:11:46,413 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-17 13:11:46,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,413 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42601,1689599458269' in zk 2023-07-17 13:11:46,413 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-17 13:11:46,413 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:11:46,414 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:11:46,413 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:46,414 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:11:46,414 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689599505326.0e16186fcb61e65fda12019cddd62011. 2023-07-17 13:11:46,414 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 13:11:46,413 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689599505326.7a9c7f3ac4bf4eb4ce7925d3ce66e6c7. 2023-07-17 13:11:46,414 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689599505326.0e16186fcb61e65fda12019cddd62011. started... 2023-07-17 13:11:46,414 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689599505326.7a9c7f3ac4bf4eb4ce7925d3ce66e6c7. started... 2023-07-17 13:11:46,414 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:11:46,414 INFO [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0e16186fcb61e65fda12019cddd62011 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-17 13:11:46,414 INFO [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7a9c7f3ac4bf4eb4ce7925d3ce66e6c7 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-17 13:11:46,415 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-17 13:11:46,415 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:46,415 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-17 13:11:46,439 INFO [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testConsecutiveExports/7a9c7f3ac4bf4eb4ce7925d3ce66e6c7/.tmp/cf/29efa41a880d4ccfac79f47fede0749e 2023-07-17 13:11:46,439 INFO [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testConsecutiveExports/0e16186fcb61e65fda12019cddd62011/.tmp/cf/b3cf2557f90b4864bb9459bab04a774b 2023-07-17 13:11:46,446 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testConsecutiveExports/0e16186fcb61e65fda12019cddd62011/.tmp/cf/b3cf2557f90b4864bb9459bab04a774b as hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testConsecutiveExports/0e16186fcb61e65fda12019cddd62011/cf/b3cf2557f90b4864bb9459bab04a774b 2023-07-17 13:11:46,446 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testConsecutiveExports/7a9c7f3ac4bf4eb4ce7925d3ce66e6c7/.tmp/cf/29efa41a880d4ccfac79f47fede0749e as hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testConsecutiveExports/7a9c7f3ac4bf4eb4ce7925d3ce66e6c7/cf/29efa41a880d4ccfac79f47fede0749e 2023-07-17 13:11:46,451 INFO [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testConsecutiveExports/0e16186fcb61e65fda12019cddd62011/cf/b3cf2557f90b4864bb9459bab04a774b, entries=3, sequenceid=6, filesize=5.0 K 2023-07-17 13:11:46,451 INFO [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testConsecutiveExports/7a9c7f3ac4bf4eb4ce7925d3ce66e6c7/cf/29efa41a880d4ccfac79f47fede0749e, entries=47, sequenceid=6, filesize=8.0 K 2023-07-17 13:11:46,452 INFO [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 0e16186fcb61e65fda12019cddd62011 in 38ms, sequenceid=6, compaction requested=false 2023-07-17 13:11:46,452 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-17 13:11:46,452 INFO [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 7a9c7f3ac4bf4eb4ce7925d3ce66e6c7 in 38ms, sequenceid=6, compaction requested=false 2023-07-17 13:11:46,452 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0e16186fcb61e65fda12019cddd62011: 2023-07-17 13:11:46,453 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7a9c7f3ac4bf4eb4ce7925d3ce66e6c7: 2023-07-17 13:11:46,453 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689599505326.0e16186fcb61e65fda12019cddd62011.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-17 13:11:46,453 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689599505326.7a9c7f3ac4bf4eb4ce7925d3ce66e6c7.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-17 13:11:46,453 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:11:46,453 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:11:46,453 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testConsecutiveExports/0e16186fcb61e65fda12019cddd62011/cf/b3cf2557f90b4864bb9459bab04a774b] hfiles 2023-07-17 13:11:46,453 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testConsecutiveExports/7a9c7f3ac4bf4eb4ce7925d3ce66e6c7/cf/29efa41a880d4ccfac79f47fede0749e] hfiles 2023-07-17 13:11:46,453 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testConsecutiveExports/0e16186fcb61e65fda12019cddd62011/cf/b3cf2557f90b4864bb9459bab04a774b for snapshot=snaptb0-testConsecutiveExports 2023-07-17 13:11:46,453 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testConsecutiveExports/7a9c7f3ac4bf4eb4ce7925d3ce66e6c7/cf/29efa41a880d4ccfac79f47fede0749e for snapshot=snaptb0-testConsecutiveExports 2023-07-17 13:11:46,472 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689599505326.0e16186fcb61e65fda12019cddd62011. completed. 2023-07-17 13:11:46,472 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689599505326.0e16186fcb61e65fda12019cddd62011. 2023-07-17 13:11:46,473 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:11:46,473 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:11:46,473 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:46,473 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-17 13:11:46,473 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45883,1689599458200' in zk 2023-07-17 13:11:46,474 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:11:46,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-17 13:11:46,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-17 13:11:46,475 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689599505326.7a9c7f3ac4bf4eb4ce7925d3ce66e6c7. completed. 2023-07-17 13:11:46,475 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689599505326.7a9c7f3ac4bf4eb4ce7925d3ce66e6c7. 2023-07-17 13:11:46,475 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:11:46,475 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 13:11:46,475 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:11:46,476 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:46,476 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-17 13:11:46,476 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43575,1689599458131' in zk 2023-07-17 13:11:46,476 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:46,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:46,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:46,476 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-17 13:11:46,476 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:46,476 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-17 13:11:46,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:46,478 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:46,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:46,478 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-17 13:11:46,479 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:46,479 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-17 13:11:46,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:46,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 13:11:46,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:46,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:46,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:46,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:46,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 13:11:46,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:46,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:46,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:46,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,45883,1689599458200': 2023-07-17 13:11:46,485 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45883,1689599458200' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-17 13:11:46,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:46,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:46,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:46,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:46,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:46,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 13:11:46,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:46,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:46,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:46,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:46,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 13:11:46,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:46,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:46,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:46,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43575,1689599458131': 2023-07-17 13:11:46,491 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43575,1689599458131' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-17 13:11:46,491 INFO [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-17 13:11:46,491 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 13:11:46,491 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 13:11:46,491 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-17 13:11:46,491 INFO [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 13:11:46,493 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,493 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,493 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,493 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:46,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,493 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:46,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,493 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,493 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:46,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:46,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:46,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:46,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:46,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:46,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:46,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:46,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:46,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,494 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:46,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:46,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,495 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:46,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 13:11:46,495 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:46,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:46,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 13:11:46,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:46,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:46,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:46,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:46,498 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:46,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 13:11:46,498 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:46,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:46,498 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:46,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:46,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:46,506 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:46,506 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:46,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:46,507 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:46,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:46,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:46,507 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:46,506 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:46,506 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:46,508 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:46,508 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,507 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-17 13:11:46,509 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-17 13:11:46,507 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:46,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:46,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:46,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:46,509 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:46,509 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:46,509 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,509 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:11:46,509 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,509 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:11:46,509 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:11:46,509 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,510 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:46,510 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:46,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:46,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:46,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:46,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:46,573 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,628 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-17 13:11:46,628 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,629 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,629 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689599506372Consolidate snapshot: snaptb0-testConsecutiveExports at 1689599506509 (+137 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1689599506509Writing data manifest for snaptb0-testConsecutiveExports at 1689599506522 (+13 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689599506565 (+43 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689599506628 (+63 ms) 2023-07-17 13:11:46,632 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-17 13:11:46,633 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 259 msec 2023-07-17 13:11:46,676 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:11:46,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-17 13:11:46,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 13:11:46,677 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/local-export-1689599506677 2023-07-17 13:11:46,678 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/local-export-1689599506677, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/local-export-1689599506677, srcFsUri=hdfs://localhost:37401, srcDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b 2023-07-17 13:11:46,704 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37401, inputRoot=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b 2023-07-17 13:11:46,704 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@3c29e1d5, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/local-export-1689599506677, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/local-export-1689599506677/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,705 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37401, inputRoot=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b, snapshotDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-17 13:11:46,720 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/local-export-1689599506677/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 13:11:46,743 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:46,743 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:46,744 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:46,744 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:47,677 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/hadoop-294165615185771895.jar 2023-07-17 13:11:47,678 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:47,678 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:47,749 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/hadoop-2445422944766348027.jar 2023-07-17 13:11:47,750 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:47,750 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:47,750 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:47,751 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:47,751 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:47,751 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:47,752 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 13:11:47,752 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 13:11:47,753 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 13:11:47,753 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 13:11:47,753 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 13:11:47,754 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 13:11:47,754 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 13:11:47,754 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 13:11:47,755 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 13:11:47,755 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 13:11:47,756 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:11:47,756 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:11:47,757 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 13:11:47,757 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:11:47,757 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:11:47,758 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 13:11:47,758 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 13:11:48,142 WARN [Listener at jenkins-hbase4.apache.org/38153] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 13:11:48,145 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-17 13:11:48,147 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-17 13:11:49,108 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 13:11:49,108 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 13:11:49,112 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467386_0002_000001 (auth:SIMPLE) 2023-07-17 13:11:49,891 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467386_0003_000001 (auth:SIMPLE) 2023-07-17 13:11:50,648 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 13:11:54,572 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467386_0003_000001 (auth:SIMPLE) 2023-07-17 13:11:56,798 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467386_0003_000001 (auth:SIMPLE) 2023-07-17 13:11:59,418 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467386_0003_000001 (auth:SIMPLE) 2023-07-17 13:12:01,377 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 13:12:01,378 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 13:12:01,381 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-17 13:12:01,381 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 13:12:01,382 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 13:12:01,382 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-233758021_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-17 13:12:01,384 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(367): hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-17 13:12:01,384 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(367): hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-17 13:12:01,385 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@211d1865 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/local-export-1689599506677/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/local-export-1689599506677/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-17 13:12:01,385 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/local-export-1689599506677/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-17 13:12:01,385 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/local-export-1689599506677/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-17 13:12:01,386 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/local-export-1689599506677, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/local-export-1689599506677, srcFsUri=hdfs://localhost:37401, srcDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b 2023-07-17 13:12:01,409 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37401, inputRoot=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b 2023-07-17 13:12:01,409 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@3b7f9015, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/local-export-1689599506677, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/local-export-1689599506677/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 13:12:01,410 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37401, inputRoot=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b, snapshotDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-17 13:12:01,419 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/local-export-1689599506677/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 13:12:01,432 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:01,432 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:01,433 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:01,433 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:02,330 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/hadoop-5273869838184553089.jar 2023-07-17 13:12:02,330 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:02,331 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:02,400 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/hadoop-5972495269776810625.jar 2023-07-17 13:12:02,400 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:02,401 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:02,401 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:02,401 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:02,402 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:02,402 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:02,402 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 13:12:02,403 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 13:12:02,403 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 13:12:02,404 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 13:12:02,404 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 13:12:02,404 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 13:12:02,405 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 13:12:02,405 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 13:12:02,405 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 13:12:02,406 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 13:12:02,406 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:12:02,407 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:12:02,407 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 13:12:02,408 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:12:02,408 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:12:02,408 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 13:12:02,409 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 13:12:02,822 WARN [Listener at jenkins-hbase4.apache.org/38153] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 13:12:02,824 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-17 13:12:02,826 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-17 13:12:05,606 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 13:12:05,607 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 13:12:05,609 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467386_0003_000001 (auth:SIMPLE) 2023-07-17 13:12:06,150 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467386_0004_000001 (auth:SIMPLE) 2023-07-17 13:12:10,710 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467386_0004_000001 (auth:SIMPLE) 2023-07-17 13:12:12,965 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467386_0004_000001 (auth:SIMPLE) 2023-07-17 13:12:16,361 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467386_0004_000001 (auth:SIMPLE) 2023-07-17 13:12:18,133 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 13:12:18,133 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 13:12:18,161 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-17 13:12:18,161 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 13:12:18,161 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 13:12:18,162 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-233758021_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-17 13:12:18,173 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(367): hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-17 13:12:18,173 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(367): hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-17 13:12:18,173 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@211d1865 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/local-export-1689599506677/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/local-export-1689599506677/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-17 13:12:18,174 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/local-export-1689599506677/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-17 13:12:18,174 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/local-export-1689599506677/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-17 13:12:18,193 INFO [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-17 13:12:18,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-17 13:12:18,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-17 13:12:18,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-17 13:12:18,200 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599538200"}]},"ts":"1689599538200"} 2023-07-17 13:12:18,202 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-17 13:12:18,204 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-17 13:12:18,206 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0e16186fcb61e65fda12019cddd62011, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7a9c7f3ac4bf4eb4ce7925d3ce66e6c7, UNASSIGN}] 2023-07-17 13:12:18,207 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7a9c7f3ac4bf4eb4ce7925d3ce66e6c7, UNASSIGN 2023-07-17 13:12:18,209 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0e16186fcb61e65fda12019cddd62011, UNASSIGN 2023-07-17 13:12:18,210 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=7a9c7f3ac4bf4eb4ce7925d3ce66e6c7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:18,210 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689599505326.7a9c7f3ac4bf4eb4ce7925d3ce66e6c7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689599538210"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599538210"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599538210"}]},"ts":"1689599538210"} 2023-07-17 13:12:18,210 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=0e16186fcb61e65fda12019cddd62011, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:18,211 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689599505326.0e16186fcb61e65fda12019cddd62011.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689599538210"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599538210"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599538210"}]},"ts":"1689599538210"} 2023-07-17 13:12:18,214 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 7a9c7f3ac4bf4eb4ce7925d3ce66e6c7, server=jenkins-hbase4.apache.org,43575,1689599458131}] 2023-07-17 13:12:18,216 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 0e16186fcb61e65fda12019cddd62011, server=jenkins-hbase4.apache.org,45883,1689599458200}] 2023-07-17 13:12:18,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-17 13:12:18,368 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7a9c7f3ac4bf4eb4ce7925d3ce66e6c7 2023-07-17 13:12:18,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7a9c7f3ac4bf4eb4ce7925d3ce66e6c7, disabling compactions & flushes 2023-07-17 13:12:18,368 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689599505326.7a9c7f3ac4bf4eb4ce7925d3ce66e6c7. 2023-07-17 13:12:18,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689599505326.7a9c7f3ac4bf4eb4ce7925d3ce66e6c7. 2023-07-17 13:12:18,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689599505326.7a9c7f3ac4bf4eb4ce7925d3ce66e6c7. after waiting 0 ms 2023-07-17 13:12:18,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689599505326.7a9c7f3ac4bf4eb4ce7925d3ce66e6c7. 2023-07-17 13:12:18,382 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0e16186fcb61e65fda12019cddd62011 2023-07-17 13:12:18,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0e16186fcb61e65fda12019cddd62011, disabling compactions & flushes 2023-07-17 13:12:18,382 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689599505326.0e16186fcb61e65fda12019cddd62011. 2023-07-17 13:12:18,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689599505326.0e16186fcb61e65fda12019cddd62011. 2023-07-17 13:12:18,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689599505326.0e16186fcb61e65fda12019cddd62011. after waiting 0 ms 2023-07-17 13:12:18,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689599505326.0e16186fcb61e65fda12019cddd62011. 2023-07-17 13:12:18,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testConsecutiveExports/0e16186fcb61e65fda12019cddd62011/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 13:12:18,431 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:12:18,432 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689599505326.0e16186fcb61e65fda12019cddd62011. 2023-07-17 13:12:18,433 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0e16186fcb61e65fda12019cddd62011: 2023-07-17 13:12:18,435 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0e16186fcb61e65fda12019cddd62011 2023-07-17 13:12:18,436 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=0e16186fcb61e65fda12019cddd62011, regionState=CLOSED 2023-07-17 13:12:18,436 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689599505326.0e16186fcb61e65fda12019cddd62011.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689599538436"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599538436"}]},"ts":"1689599538436"} 2023-07-17 13:12:18,440 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-17 13:12:18,440 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 0e16186fcb61e65fda12019cddd62011, server=jenkins-hbase4.apache.org,45883,1689599458200 in 222 msec 2023-07-17 13:12:18,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testConsecutiveExports/7a9c7f3ac4bf4eb4ce7925d3ce66e6c7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 13:12:18,442 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0e16186fcb61e65fda12019cddd62011, UNASSIGN in 234 msec 2023-07-17 13:12:18,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:12:18,455 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689599505326.7a9c7f3ac4bf4eb4ce7925d3ce66e6c7. 2023-07-17 13:12:18,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7a9c7f3ac4bf4eb4ce7925d3ce66e6c7: 2023-07-17 13:12:18,457 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7a9c7f3ac4bf4eb4ce7925d3ce66e6c7 2023-07-17 13:12:18,458 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=7a9c7f3ac4bf4eb4ce7925d3ce66e6c7, regionState=CLOSED 2023-07-17 13:12:18,458 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689599505326.7a9c7f3ac4bf4eb4ce7925d3ce66e6c7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689599538458"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599538458"}]},"ts":"1689599538458"} 2023-07-17 13:12:18,471 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-17 13:12:18,471 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 7a9c7f3ac4bf4eb4ce7925d3ce66e6c7, server=jenkins-hbase4.apache.org,43575,1689599458131 in 249 msec 2023-07-17 13:12:18,473 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-17 13:12:18,473 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7a9c7f3ac4bf4eb4ce7925d3ce66e6c7, UNASSIGN in 265 msec 2023-07-17 13:12:18,474 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599538474"}]},"ts":"1689599538474"} 2023-07-17 13:12:18,476 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-17 13:12:18,477 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-17 13:12:18,479 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 284 msec 2023-07-17 13:12:18,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-17 13:12:18,503 INFO [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-17 13:12:18,504 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-17 13:12:18,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-17 13:12:18,509 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-17 13:12:18,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-17 13:12:18,512 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-17 13:12:18,515 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43575] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-17 13:12:18,525 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 13:12:18,525 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 13:12:18,525 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-17 13:12:18,525 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-17 13:12:18,526 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 13:12:18,526 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 13:12:18,526 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-17 13:12:18,526 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-17 13:12:18,528 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 13:12:18,528 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:18,528 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 13:12:18,528 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:18,528 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 13:12:18,529 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:18,529 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 13:12:18,529 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:18,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-17 13:12:18,542 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testConsecutiveExports/0e16186fcb61e65fda12019cddd62011 2023-07-17 13:12:18,544 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testConsecutiveExports/7a9c7f3ac4bf4eb4ce7925d3ce66e6c7 2023-07-17 13:12:18,545 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testConsecutiveExports/0e16186fcb61e65fda12019cddd62011/cf, FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testConsecutiveExports/0e16186fcb61e65fda12019cddd62011/recovered.edits] 2023-07-17 13:12:18,554 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testConsecutiveExports/7a9c7f3ac4bf4eb4ce7925d3ce66e6c7/cf, FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testConsecutiveExports/7a9c7f3ac4bf4eb4ce7925d3ce66e6c7/recovered.edits] 2023-07-17 13:12:18,560 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testConsecutiveExports/0e16186fcb61e65fda12019cddd62011/cf/b3cf2557f90b4864bb9459bab04a774b to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/archive/data/default/testtb-testConsecutiveExports/0e16186fcb61e65fda12019cddd62011/cf/b3cf2557f90b4864bb9459bab04a774b 2023-07-17 13:12:18,566 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testConsecutiveExports/0e16186fcb61e65fda12019cddd62011/recovered.edits/9.seqid to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/archive/data/default/testtb-testConsecutiveExports/0e16186fcb61e65fda12019cddd62011/recovered.edits/9.seqid 2023-07-17 13:12:18,575 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testConsecutiveExports/7a9c7f3ac4bf4eb4ce7925d3ce66e6c7/cf/29efa41a880d4ccfac79f47fede0749e to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/archive/data/default/testtb-testConsecutiveExports/7a9c7f3ac4bf4eb4ce7925d3ce66e6c7/cf/29efa41a880d4ccfac79f47fede0749e 2023-07-17 13:12:18,575 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testConsecutiveExports/0e16186fcb61e65fda12019cddd62011 2023-07-17 13:12:18,579 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testConsecutiveExports/7a9c7f3ac4bf4eb4ce7925d3ce66e6c7/recovered.edits/9.seqid to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/archive/data/default/testtb-testConsecutiveExports/7a9c7f3ac4bf4eb4ce7925d3ce66e6c7/recovered.edits/9.seqid 2023-07-17 13:12:18,579 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testConsecutiveExports/7a9c7f3ac4bf4eb4ce7925d3ce66e6c7 2023-07-17 13:12:18,579 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-17 13:12:18,587 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-17 13:12:18,594 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-17 13:12:18,606 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-17 13:12:18,607 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-17 13:12:18,607 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-17 13:12:18,608 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689599505326.0e16186fcb61e65fda12019cddd62011.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689599538608"}]},"ts":"9223372036854775807"} 2023-07-17 13:12:18,608 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689599505326.7a9c7f3ac4bf4eb4ce7925d3ce66e6c7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689599538608"}]},"ts":"9223372036854775807"} 2023-07-17 13:12:18,616 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-17 13:12:18,616 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0e16186fcb61e65fda12019cddd62011, NAME => 'testtb-testConsecutiveExports,,1689599505326.0e16186fcb61e65fda12019cddd62011.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 7a9c7f3ac4bf4eb4ce7925d3ce66e6c7, NAME => 'testtb-testConsecutiveExports,1,1689599505326.7a9c7f3ac4bf4eb4ce7925d3ce66e6c7.', STARTKEY => '1', ENDKEY => ''}] 2023-07-17 13:12:18,616 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-17 13:12:18,617 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689599538616"}]},"ts":"9223372036854775807"} 2023-07-17 13:12:18,629 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-17 13:12:18,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-17 13:12:18,632 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-17 13:12:18,634 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 128 msec 2023-07-17 13:12:18,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-17 13:12:18,834 INFO [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-17 13:12:18,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-17 13:12:18,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-17 13:12:18,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-17 13:12:18,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-17 13:12:18,914 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=748 (was 765), OpenFileDescriptor=893 (was 928), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=430 (was 433), ProcessCount=186 (was 181) - ProcessCount LEAK? -, AvailableMemoryMB=2588 (was 3223) 2023-07-17 13:12:18,914 WARN [Listener at jenkins-hbase4.apache.org/38153] hbase.ResourceChecker(130): Thread=748 is superior to 500 2023-07-17 13:12:18,944 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=748, OpenFileDescriptor=893, MaxFileDescriptor=60000, SystemLoadAverage=430, ProcessCount=186, AvailableMemoryMB=2587 2023-07-17 13:12:18,944 WARN [Listener at jenkins-hbase4.apache.org/38153] hbase.ResourceChecker(130): Thread=748 is superior to 500 2023-07-17 13:12:18,946 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-17 13:12:18,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:18,952 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 13:12:18,952 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-17 13:12:18,953 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 13:12:18,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-17 13:12:18,959 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/08902eb27b867f8ee32a529c7fd41186 2023-07-17 13:12:18,959 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/fad2aa5fcc378cfa825646823d2fbe29 2023-07-17 13:12:18,960 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/fad2aa5fcc378cfa825646823d2fbe29 empty. 2023-07-17 13:12:18,960 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/08902eb27b867f8ee32a529c7fd41186 empty. 2023-07-17 13:12:18,960 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/fad2aa5fcc378cfa825646823d2fbe29 2023-07-17 13:12:18,960 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/08902eb27b867f8ee32a529c7fd41186 2023-07-17 13:12:18,960 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-17 13:12:18,989 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-17 13:12:18,990 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 08902eb27b867f8ee32a529c7fd41186, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689599538946.08902eb27b867f8ee32a529c7fd41186.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp 2023-07-17 13:12:18,991 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => fad2aa5fcc378cfa825646823d2fbe29, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689599538946.fad2aa5fcc378cfa825646823d2fbe29.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp 2023-07-17 13:12:19,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-17 13:12:19,111 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689599538946.08902eb27b867f8ee32a529c7fd41186.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:12:19,111 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 08902eb27b867f8ee32a529c7fd41186, disabling compactions & flushes 2023-07-17 13:12:19,112 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689599538946.08902eb27b867f8ee32a529c7fd41186. 2023-07-17 13:12:19,112 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689599538946.08902eb27b867f8ee32a529c7fd41186. 2023-07-17 13:12:19,112 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689599538946.08902eb27b867f8ee32a529c7fd41186. after waiting 0 ms 2023-07-17 13:12:19,112 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689599538946.08902eb27b867f8ee32a529c7fd41186. 2023-07-17 13:12:19,112 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689599538946.08902eb27b867f8ee32a529c7fd41186. 2023-07-17 13:12:19,112 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 08902eb27b867f8ee32a529c7fd41186: 2023-07-17 13:12:19,119 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689599538946.fad2aa5fcc378cfa825646823d2fbe29.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:12:19,119 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing fad2aa5fcc378cfa825646823d2fbe29, disabling compactions & flushes 2023-07-17 13:12:19,119 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689599538946.fad2aa5fcc378cfa825646823d2fbe29. 2023-07-17 13:12:19,119 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689599538946.fad2aa5fcc378cfa825646823d2fbe29. 2023-07-17 13:12:19,119 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689599538946.fad2aa5fcc378cfa825646823d2fbe29. after waiting 0 ms 2023-07-17 13:12:19,119 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689599538946.fad2aa5fcc378cfa825646823d2fbe29. 2023-07-17 13:12:19,119 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689599538946.fad2aa5fcc378cfa825646823d2fbe29. 2023-07-17 13:12:19,119 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for fad2aa5fcc378cfa825646823d2fbe29: 2023-07-17 13:12:19,122 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 13:12:19,123 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689599538946.08902eb27b867f8ee32a529c7fd41186.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689599539123"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599539123"}]},"ts":"1689599539123"} 2023-07-17 13:12:19,123 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689599538946.fad2aa5fcc378cfa825646823d2fbe29.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689599539123"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599539123"}]},"ts":"1689599539123"} 2023-07-17 13:12:19,135 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 13:12:19,137 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 13:12:19,137 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599539137"}]},"ts":"1689599539137"} 2023-07-17 13:12:19,139 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-17 13:12:19,143 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 13:12:19,145 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 13:12:19,145 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 13:12:19,145 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 13:12:19,145 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 13:12:19,145 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=08902eb27b867f8ee32a529c7fd41186, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=fad2aa5fcc378cfa825646823d2fbe29, ASSIGN}] 2023-07-17 13:12:19,148 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=fad2aa5fcc378cfa825646823d2fbe29, ASSIGN 2023-07-17 13:12:19,148 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=08902eb27b867f8ee32a529c7fd41186, ASSIGN 2023-07-17 13:12:19,150 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=08902eb27b867f8ee32a529c7fd41186, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43575,1689599458131; forceNewPlan=false, retain=false 2023-07-17 13:12:19,150 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=fad2aa5fcc378cfa825646823d2fbe29, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45883,1689599458200; forceNewPlan=false, retain=false 2023-07-17 13:12:19,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-17 13:12:19,300 INFO [jenkins-hbase4:44069] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 13:12:19,304 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=fad2aa5fcc378cfa825646823d2fbe29, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:19,304 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=08902eb27b867f8ee32a529c7fd41186, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:19,304 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689599538946.fad2aa5fcc378cfa825646823d2fbe29.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689599539304"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599539304"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599539304"}]},"ts":"1689599539304"} 2023-07-17 13:12:19,304 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689599538946.08902eb27b867f8ee32a529c7fd41186.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689599539304"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599539304"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599539304"}]},"ts":"1689599539304"} 2023-07-17 13:12:19,307 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure fad2aa5fcc378cfa825646823d2fbe29, server=jenkins-hbase4.apache.org,45883,1689599458200}] 2023-07-17 13:12:19,308 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 08902eb27b867f8ee32a529c7fd41186, server=jenkins-hbase4.apache.org,43575,1689599458131}] 2023-07-17 13:12:19,467 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689599538946.08902eb27b867f8ee32a529c7fd41186. 2023-07-17 13:12:19,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 08902eb27b867f8ee32a529c7fd41186, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689599538946.08902eb27b867f8ee32a529c7fd41186.', STARTKEY => '', ENDKEY => '1'} 2023-07-17 13:12:19,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689599538946.08902eb27b867f8ee32a529c7fd41186. service=AccessControlService 2023-07-17 13:12:19,468 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 13:12:19,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 08902eb27b867f8ee32a529c7fd41186 2023-07-17 13:12:19,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689599538946.08902eb27b867f8ee32a529c7fd41186.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:12:19,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 08902eb27b867f8ee32a529c7fd41186 2023-07-17 13:12:19,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 08902eb27b867f8ee32a529c7fd41186 2023-07-17 13:12:19,470 INFO [StoreOpener-08902eb27b867f8ee32a529c7fd41186-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 08902eb27b867f8ee32a529c7fd41186 2023-07-17 13:12:19,472 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689599538946.fad2aa5fcc378cfa825646823d2fbe29. 2023-07-17 13:12:19,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fad2aa5fcc378cfa825646823d2fbe29, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689599538946.fad2aa5fcc378cfa825646823d2fbe29.', STARTKEY => '1', ENDKEY => ''} 2023-07-17 13:12:19,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689599538946.fad2aa5fcc378cfa825646823d2fbe29. service=AccessControlService 2023-07-17 13:12:19,472 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 13:12:19,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion fad2aa5fcc378cfa825646823d2fbe29 2023-07-17 13:12:19,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689599538946.fad2aa5fcc378cfa825646823d2fbe29.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:12:19,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fad2aa5fcc378cfa825646823d2fbe29 2023-07-17 13:12:19,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fad2aa5fcc378cfa825646823d2fbe29 2023-07-17 13:12:19,473 DEBUG [StoreOpener-08902eb27b867f8ee32a529c7fd41186-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion/08902eb27b867f8ee32a529c7fd41186/cf 2023-07-17 13:12:19,474 DEBUG [StoreOpener-08902eb27b867f8ee32a529c7fd41186-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion/08902eb27b867f8ee32a529c7fd41186/cf 2023-07-17 13:12:19,475 INFO [StoreOpener-08902eb27b867f8ee32a529c7fd41186-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08902eb27b867f8ee32a529c7fd41186 columnFamilyName cf 2023-07-17 13:12:19,479 INFO [StoreOpener-08902eb27b867f8ee32a529c7fd41186-1] regionserver.HStore(310): Store=08902eb27b867f8ee32a529c7fd41186/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:12:19,479 INFO [StoreOpener-fad2aa5fcc378cfa825646823d2fbe29-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fad2aa5fcc378cfa825646823d2fbe29 2023-07-17 13:12:19,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion/08902eb27b867f8ee32a529c7fd41186 2023-07-17 13:12:19,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion/08902eb27b867f8ee32a529c7fd41186 2023-07-17 13:12:19,482 DEBUG [StoreOpener-fad2aa5fcc378cfa825646823d2fbe29-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion/fad2aa5fcc378cfa825646823d2fbe29/cf 2023-07-17 13:12:19,482 DEBUG [StoreOpener-fad2aa5fcc378cfa825646823d2fbe29-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion/fad2aa5fcc378cfa825646823d2fbe29/cf 2023-07-17 13:12:19,483 INFO [StoreOpener-fad2aa5fcc378cfa825646823d2fbe29-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fad2aa5fcc378cfa825646823d2fbe29 columnFamilyName cf 2023-07-17 13:12:19,483 INFO [StoreOpener-fad2aa5fcc378cfa825646823d2fbe29-1] regionserver.HStore(310): Store=fad2aa5fcc378cfa825646823d2fbe29/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:12:19,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 08902eb27b867f8ee32a529c7fd41186 2023-07-17 13:12:19,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion/fad2aa5fcc378cfa825646823d2fbe29 2023-07-17 13:12:19,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion/fad2aa5fcc378cfa825646823d2fbe29 2023-07-17 13:12:19,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion/08902eb27b867f8ee32a529c7fd41186/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 13:12:19,487 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 08902eb27b867f8ee32a529c7fd41186; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59780814, jitterRate=-0.10919645428657532}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 13:12:19,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 08902eb27b867f8ee32a529c7fd41186: 2023-07-17 13:12:19,489 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689599538946.08902eb27b867f8ee32a529c7fd41186., pid=61, masterSystemTime=1689599539464 2023-07-17 13:12:19,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fad2aa5fcc378cfa825646823d2fbe29 2023-07-17 13:12:19,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689599538946.08902eb27b867f8ee32a529c7fd41186. 2023-07-17 13:12:19,491 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689599538946.08902eb27b867f8ee32a529c7fd41186. 2023-07-17 13:12:19,492 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=08902eb27b867f8ee32a529c7fd41186, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:19,492 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689599538946.08902eb27b867f8ee32a529c7fd41186.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689599539492"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689599539492"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689599539492"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689599539492"}]},"ts":"1689599539492"} 2023-07-17 13:12:19,499 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-17 13:12:19,499 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 08902eb27b867f8ee32a529c7fd41186, server=jenkins-hbase4.apache.org,43575,1689599458131 in 188 msec 2023-07-17 13:12:19,503 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=08902eb27b867f8ee32a529c7fd41186, ASSIGN in 354 msec 2023-07-17 13:12:19,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion/fad2aa5fcc378cfa825646823d2fbe29/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 13:12:19,506 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fad2aa5fcc378cfa825646823d2fbe29; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73655341, jitterRate=0.09755010902881622}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 13:12:19,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fad2aa5fcc378cfa825646823d2fbe29: 2023-07-17 13:12:19,507 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689599538946.fad2aa5fcc378cfa825646823d2fbe29., pid=60, masterSystemTime=1689599539463 2023-07-17 13:12:19,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689599538946.fad2aa5fcc378cfa825646823d2fbe29. 2023-07-17 13:12:19,509 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689599538946.fad2aa5fcc378cfa825646823d2fbe29. 2023-07-17 13:12:19,510 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=fad2aa5fcc378cfa825646823d2fbe29, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:19,510 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689599538946.fad2aa5fcc378cfa825646823d2fbe29.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689599539510"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689599539510"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689599539510"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689599539510"}]},"ts":"1689599539510"} 2023-07-17 13:12:19,520 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-17 13:12:19,520 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure fad2aa5fcc378cfa825646823d2fbe29, server=jenkins-hbase4.apache.org,45883,1689599458200 in 210 msec 2023-07-17 13:12:19,532 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-17 13:12:19,532 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=fad2aa5fcc378cfa825646823d2fbe29, ASSIGN in 375 msec 2023-07-17 13:12:19,533 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 13:12:19,533 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599539533"}]},"ts":"1689599539533"} 2023-07-17 13:12:19,540 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-17 13:12:19,547 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 13:12:19,547 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-17 13:12:19,550 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43575] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-17 13:12:19,551 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:19,551 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:19,552 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:19,552 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:19,555 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:19,555 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:19,555 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:19,556 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:19,556 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:19,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-17 13:12:19,567 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 612 msec 2023-07-17 13:12:20,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-17 13:12:20,060 INFO [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-17 13:12:20,060 DEBUG [Listener at jenkins-hbase4.apache.org/38153] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-17 13:12:20,060 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 13:12:20,064 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-17 13:12:20,064 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 13:12:20,064 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-17 13:12:20,069 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-17 13:12:20,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689599540069 (current time:1689599540069). 2023-07-17 13:12:20,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 13:12:20,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(139): Connect 0x28007c0d to 127.0.0.1:56233 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:12:20,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d5bacb8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:12:20,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:12:20,079 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45646, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:12:20,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x28007c0d to 127.0.0.1:56233 2023-07-17 13:12:20,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:12:20,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(139): Connect 0x696fdaac to 127.0.0.1:56233 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:12:20,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42242398, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:12:20,096 DEBUG [hconnection-0x429a6908-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:12:20,101 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45656, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:12:20,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:12:20,109 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36740, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:12:20,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x696fdaac to 127.0.0.1:56233 2023-07-17 13:12:20,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:12:20,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-17 13:12:20,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 13:12:20,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-17 13:12:20,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-17 13:12:20,115 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-17 13:12:20,119 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689600140119 2023-07-17 13:12:20,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-17 13:12:20,119 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,120 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 13:12:20,120 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 13:12:20,123 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-17 13:12:20,124 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-17 13:12:20,125 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 11 msec 2023-07-17 13:12:20,126 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-17 13:12:20,127 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689600140127 2023-07-17 13:12:20,140 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,140 INFO [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-17 13:12:20,141 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:20,142 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-17 13:12:20,142 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-17 13:12:20,218 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,218 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,220 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:20,220 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:20,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:20,220 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:20,220 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:20,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:20,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:20,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:20,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:20,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:20,220 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:12:20,221 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:20,221 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:20,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,222 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,222 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,222 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:20,222 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 13:12:20,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-17 13:12:20,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-17 13:12:20,222 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-17 13:12:20,222 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 13:12:20,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-17 13:12:20,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-17 13:12:20,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,223 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-17 13:12:20,223 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-17 13:12:20,223 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-17 13:12:20,223 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,223 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,223 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-17 13:12:20,223 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-17 13:12:20,223 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:20,223 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:20,225 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-17 13:12:20,223 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,226 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-17 13:12:20,226 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-17 13:12:20,226 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-17 13:12:20,226 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45883,1689599458200' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-17 13:12:20,226 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-17 13:12:20,226 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:20,226 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43575,1689599458131' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-17 13:12:20,227 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-17 13:12:20,227 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-17 13:12:20,227 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42601,1689599458269' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-17 13:12:20,229 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,229 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:20,229 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:20,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:20,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:20,229 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:20,231 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,231 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:20,231 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,231 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:12:20,231 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:12:20,231 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:20,232 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:12:20,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:20,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:20,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:20,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:20,234 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45883,1689599458200' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-17 13:12:20,234 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1f4c41d0[Count = 1] remaining members to acquire global barrier 2023-07-17 13:12:20,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:20,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:20,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:20,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:20,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:20,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:20,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:20,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:20,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:20,236 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43575,1689599458131' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-17 13:12:20,236 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1f4c41d0[Count = 0] remaining members to acquire global barrier 2023-07-17 13:12:20,236 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-17 13:12:20,236 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,238 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,238 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,238 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,238 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-17 13:12:20,238 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:20,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,238 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-17 13:12:20,239 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-17 13:12:20,239 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-17 13:12:20,239 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42601,1689599458269' in zk 2023-07-17 13:12:20,239 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:12:20,239 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:12:20,239 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:20,239 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 13:12:20,239 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:12:20,239 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689599538946.fad2aa5fcc378cfa825646823d2fbe29. 2023-07-17 13:12:20,239 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689599538946.08902eb27b867f8ee32a529c7fd41186. 2023-07-17 13:12:20,239 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689599538946.fad2aa5fcc378cfa825646823d2fbe29. started... 2023-07-17 13:12:20,239 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:12:20,239 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689599538946.08902eb27b867f8ee32a529c7fd41186. started... 2023-07-17 13:12:20,241 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fad2aa5fcc378cfa825646823d2fbe29: 2023-07-17 13:12:20,242 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 08902eb27b867f8ee32a529c7fd41186: 2023-07-17 13:12:20,242 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689599538946.fad2aa5fcc378cfa825646823d2fbe29.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,242 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689599538946.08902eb27b867f8ee32a529c7fd41186.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,242 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:12:20,242 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:12:20,243 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 13:12:20,243 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 13:12:20,247 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-17 13:12:20,247 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:12:20,247 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-17 13:12:20,270 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689599538946.fad2aa5fcc378cfa825646823d2fbe29. completed. 2023-07-17 13:12:20,270 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689599538946.fad2aa5fcc378cfa825646823d2fbe29. 2023-07-17 13:12:20,270 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:12:20,270 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:12:20,270 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:20,274 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-17 13:12:20,275 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45883,1689599458200' in zk 2023-07-17 13:12:20,277 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:20,277 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-17 13:12:20,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:20,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:20,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:20,277 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:12:20,277 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-17 13:12:20,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:20,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:20,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:20,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:20,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:20,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:20,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:20,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:20,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,45883,1689599458200': 2023-07-17 13:12:20,281 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45883,1689599458200' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-17 13:12:20,287 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689599538946.08902eb27b867f8ee32a529c7fd41186. completed. 2023-07-17 13:12:20,287 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689599538946.08902eb27b867f8ee32a529c7fd41186. 2023-07-17 13:12:20,287 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:12:20,287 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:12:20,287 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:20,287 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-17 13:12:20,287 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43575,1689599458131' in zk 2023-07-17 13:12:20,290 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:20,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:20,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:20,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:20,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:20,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:20,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:20,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:20,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:20,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:20,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:20,295 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-17 13:12:20,295 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:12:20,295 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-17 13:12:20,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:20,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:20,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43575,1689599458131': 2023-07-17 13:12:20,299 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43575,1689599458131' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-17 13:12:20,300 INFO [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-17 13:12:20,300 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 13:12:20,300 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 13:12:20,300 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,300 INFO [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 13:12:20,304 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,304 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,304 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,304 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,304 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:20,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:20,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:20,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:20,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:20,304 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:20,304 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:20,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:20,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:20,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:20,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:20,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:20,308 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:20,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,309 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:20,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:20,309 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:20,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:20,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:20,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:20,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:20,312 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:20,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,312 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:20,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:20,313 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:20,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:20,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:20,320 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:20,321 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,321 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:20,321 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:20,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:20,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:20,321 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:20,321 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:12:20,321 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:20,321 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,323 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:20,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:20,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:20,321 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:20,321 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:20,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:20,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:20,321 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:20,323 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:20,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:20,323 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,324 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:20,321 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,324 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:20,324 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:20,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:20,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:20,324 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,324 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:20,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:20,325 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,366 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,422 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:12:20,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-17 13:12:20,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-17 13:12:20,424 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 13:12:20,724 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:12:20,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-17 13:12:20,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-17 13:12:20,726 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-17 13:12:20,807 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-17 13:12:20,808 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,808 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:20,808 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689599540119Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689599540324 (+205 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689599540324Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689599540335 (+11 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689599540358 (+23 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689599540807 (+449 ms) 2023-07-17 13:12:20,812 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-17 13:12:20,813 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 692 msec 2023-07-17 13:12:21,226 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:12:21,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-17 13:12:21,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 13:12:21,236 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43575] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689599538946.08902eb27b867f8ee32a529c7fd41186. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 13:12:21,238 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45883] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689599538946.fad2aa5fcc378cfa825646823d2fbe29. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 13:12:21,243 DEBUG [Listener at jenkins-hbase4.apache.org/38153] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,243 DEBUG [Listener at jenkins-hbase4.apache.org/38153] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689599538946.08902eb27b867f8ee32a529c7fd41186. 2023-07-17 13:12:21,243 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 13:12:21,256 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-17 13:12:21,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689599541256 (current time:1689599541256). 2023-07-17 13:12:21,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 13:12:21,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(139): Connect 0x46f61ca4 to 127.0.0.1:56233 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:12:21,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c280cfd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:12:21,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:12:21,268 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54392, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:12:21,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x46f61ca4 to 127.0.0.1:56233 2023-07-17 13:12:21,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:12:21,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(139): Connect 0x41a1ddc3 to 127.0.0.1:56233 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:12:21,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37c4fa6f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:12:21,279 DEBUG [hconnection-0xbb7578e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:12:21,282 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54394, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:12:21,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:12:21,288 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33364, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:12:21,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x41a1ddc3 to 127.0.0.1:56233 2023-07-17 13:12:21,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:12:21,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-17 13:12:21,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 13:12:21,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-17 13:12:21,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-17 13:12:21,294 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-17 13:12:21,294 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689600141294 2023-07-17 13:12:21,294 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-17 13:12:21,296 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 13:12:21,296 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 13:12:21,296 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-17 13:12:21,297 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-17 13:12:21,298 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-07-17 13:12:21,299 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-17 13:12:21,300 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689600141300 2023-07-17 13:12:21,311 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,311 INFO [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-17 13:12:21,311 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:21,313 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-17 13:12:21,313 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-17 13:12:21,316 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,316 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,317 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:21,317 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:21,317 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:21,317 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:21,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:21,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:21,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:21,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:21,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:21,318 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:21,318 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:21,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:21,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,318 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:21,318 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 13:12:21,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,319 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,319 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,319 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-17 13:12:21,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-17 13:12:21,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,319 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-17 13:12:21,319 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-17 13:12:21,320 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,320 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,320 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-17 13:12:21,320 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:21,320 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-17 13:12:21,321 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-17 13:12:21,321 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-17 13:12:21,321 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:21,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-17 13:12:21,322 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-17 13:12:21,322 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-17 13:12:21,321 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45883,1689599458200' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-17 13:12:21,322 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42601,1689599458269' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-17 13:12:21,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,323 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-17 13:12:21,324 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:21,324 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:21,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:21,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:21,325 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:21,325 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,325 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:12:21,325 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,325 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-17 13:12:21,325 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:21,325 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:21,325 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:12:21,326 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-17 13:12:21,326 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-17 13:12:21,326 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43575,1689599458131' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-17 13:12:21,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:21,328 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:21,328 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:21,329 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:21,329 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:12:21,329 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45883,1689599458200' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-17 13:12:21,329 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c65612[Count = 1] remaining members to acquire global barrier 2023-07-17 13:12:21,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:21,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:21,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:21,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:21,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:21,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:21,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:21,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:21,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:21,331 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43575,1689599458131' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-17 13:12:21,331 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c65612[Count = 0] remaining members to acquire global barrier 2023-07-17 13:12:21,331 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-17 13:12:21,331 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,332 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,332 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,333 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,333 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-17 13:12:21,333 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-17 13:12:21,333 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:21,333 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-17 13:12:21,333 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:12:21,333 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:12:21,333 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689599538946.08902eb27b867f8ee32a529c7fd41186. 2023-07-17 13:12:21,333 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-17 13:12:21,333 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689599538946.08902eb27b867f8ee32a529c7fd41186. started... 2023-07-17 13:12:21,333 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689599538946.fad2aa5fcc378cfa825646823d2fbe29. 2023-07-17 13:12:21,333 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:21,333 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 13:12:21,333 INFO [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 08902eb27b867f8ee32a529c7fd41186 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-17 13:12:21,333 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42601,1689599458269' in zk 2023-07-17 13:12:21,333 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:12:21,334 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:12:21,333 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689599538946.fad2aa5fcc378cfa825646823d2fbe29. started... 2023-07-17 13:12:21,334 INFO [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] regionserver.HRegion(2745): Flushing fad2aa5fcc378cfa825646823d2fbe29 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-17 13:12:21,335 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-17 13:12:21,335 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:12:21,335 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-17 13:12:21,351 INFO [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion/08902eb27b867f8ee32a529c7fd41186/.tmp/cf/9d3b09621adc4497ae4e9b8ce4c57660 2023-07-17 13:12:21,354 INFO [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion/fad2aa5fcc378cfa825646823d2fbe29/.tmp/cf/b2264397384e49ddbf3f34b658680918 2023-07-17 13:12:21,357 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion/08902eb27b867f8ee32a529c7fd41186/.tmp/cf/9d3b09621adc4497ae4e9b8ce4c57660 as hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion/08902eb27b867f8ee32a529c7fd41186/cf/9d3b09621adc4497ae4e9b8ce4c57660 2023-07-17 13:12:21,363 INFO [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion/08902eb27b867f8ee32a529c7fd41186/cf/9d3b09621adc4497ae4e9b8ce4c57660, entries=2, sequenceid=6, filesize=5.0 K 2023-07-17 13:12:21,364 INFO [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 08902eb27b867f8ee32a529c7fd41186 in 31ms, sequenceid=6, compaction requested=false 2023-07-17 13:12:21,364 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-17 13:12:21,365 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 08902eb27b867f8ee32a529c7fd41186: 2023-07-17 13:12:21,365 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689599538946.08902eb27b867f8ee32a529c7fd41186.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,365 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:12:21,365 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion/08902eb27b867f8ee32a529c7fd41186/cf/9d3b09621adc4497ae4e9b8ce4c57660] hfiles 2023-07-17 13:12:21,366 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion/08902eb27b867f8ee32a529c7fd41186/cf/9d3b09621adc4497ae4e9b8ce4c57660 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,367 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion/fad2aa5fcc378cfa825646823d2fbe29/.tmp/cf/b2264397384e49ddbf3f34b658680918 as hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion/fad2aa5fcc378cfa825646823d2fbe29/cf/b2264397384e49ddbf3f34b658680918 2023-07-17 13:12:21,375 INFO [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion/fad2aa5fcc378cfa825646823d2fbe29/cf/b2264397384e49ddbf3f34b658680918, entries=48, sequenceid=6, filesize=8.1 K 2023-07-17 13:12:21,376 INFO [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for fad2aa5fcc378cfa825646823d2fbe29 in 42ms, sequenceid=6, compaction requested=false 2023-07-17 13:12:21,380 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fad2aa5fcc378cfa825646823d2fbe29: 2023-07-17 13:12:21,380 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689599538946.fad2aa5fcc378cfa825646823d2fbe29.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,380 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:12:21,380 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion/fad2aa5fcc378cfa825646823d2fbe29/cf/b2264397384e49ddbf3f34b658680918] hfiles 2023-07-17 13:12:21,380 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion/fad2aa5fcc378cfa825646823d2fbe29/cf/b2264397384e49ddbf3f34b658680918 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,382 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689599538946.08902eb27b867f8ee32a529c7fd41186. completed. 2023-07-17 13:12:21,382 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689599538946.08902eb27b867f8ee32a529c7fd41186. 2023-07-17 13:12:21,382 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:12:21,382 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:12:21,383 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:21,383 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-17 13:12:21,383 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43575,1689599458131' in zk 2023-07-17 13:12:21,384 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:21,384 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-17 13:12:21,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:21,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:21,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:21,385 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:12:21,385 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-17 13:12:21,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:21,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:21,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:21,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:21,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:21,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:21,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:21,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:21,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43575,1689599458131': 2023-07-17 13:12:21,390 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43575,1689599458131' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-17 13:12:21,394 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689599538946.fad2aa5fcc378cfa825646823d2fbe29. completed. 2023-07-17 13:12:21,394 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689599538946.fad2aa5fcc378cfa825646823d2fbe29. 2023-07-17 13:12:21,394 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:12:21,394 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:12:21,394 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:21,394 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-17 13:12:21,394 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45883,1689599458200' in zk 2023-07-17 13:12:21,396 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:12:21,397 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:21,397 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-17 13:12:21,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:21,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:21,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:21,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-17 13:12:21,397 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:12:21,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-17 13:12:21,397 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-17 13:12:21,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:21,399 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 13:12:21,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:21,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:21,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:21,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:21,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:21,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:21,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:21,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:21,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,45883,1689599458200': 2023-07-17 13:12:21,403 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45883,1689599458200' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-17 13:12:21,403 INFO [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-17 13:12:21,403 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 13:12:21,403 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 13:12:21,403 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,403 INFO [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 13:12:21,409 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,409 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,409 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:21,409 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,409 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,409 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:21,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,410 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:21,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:21,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:21,410 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:21,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:21,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:21,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:21,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:21,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,411 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:21,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,412 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:21,413 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:21,414 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:21,414 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:21,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:21,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:21,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:21,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:21,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,417 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:21,417 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,417 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:21,417 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:21,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:21,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:21,417 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:21,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:21,418 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:12:21,417 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:21,419 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:21,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:21,418 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:21,417 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:21,417 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:21,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:21,419 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,419 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:21,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:21,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:21,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:21,419 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:21,420 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion because node does not exist (not an error) 2023-07-17 13:12:21,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:21,420 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:21,420 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,420 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:21,420 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:21,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:21,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:21,420 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,420 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,420 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,454 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,484 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-17 13:12:21,484 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,485 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:21,485 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689599541294Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689599541419 (+125 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689599541420 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689599541428 (+8 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689599541447 (+19 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689599541484 (+37 ms) 2023-07-17 13:12:21,487 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-17 13:12:21,489 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 192 msec 2023-07-17 13:12:21,600 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:12:21,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-17 13:12:21,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 13:12:21,641 DEBUG [Listener at jenkins-hbase4.apache.org/38153] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-17 13:12:21,645 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54396, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-17 13:12:21,647 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-17 13:12:21,647 DEBUG [Listener at jenkins-hbase4.apache.org/38153] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-17 13:12:21,650 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33378, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-17 13:12:21,651 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43575] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-17 13:12:21,651 DEBUG [Listener at jenkins-hbase4.apache.org/38153] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-17 13:12:21,657 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52660, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-17 13:12:21,657 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45883] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-17 13:12:21,659 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-17 13:12:21,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:21,662 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 13:12:21,662 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-17 13:12:21,663 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 13:12:21,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-17 13:12:21,665 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/21d812586195e63e542da296d685eaac 2023-07-17 13:12:21,665 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9cdaa742d914cd7e269c831fe220a0fa 2023-07-17 13:12:21,666 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/21d812586195e63e542da296d685eaac empty. 2023-07-17 13:12:21,666 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9cdaa742d914cd7e269c831fe220a0fa empty. 2023-07-17 13:12:21,666 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/21d812586195e63e542da296d685eaac 2023-07-17 13:12:21,666 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9cdaa742d914cd7e269c831fe220a0fa 2023-07-17 13:12:21,667 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-17 13:12:21,678 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-17 13:12:21,679 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 21d812586195e63e542da296d685eaac, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541659.21d812586195e63e542da296d685eaac.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp 2023-07-17 13:12:21,680 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9cdaa742d914cd7e269c831fe220a0fa, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599541659.9cdaa742d914cd7e269c831fe220a0fa.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp 2023-07-17 13:12:21,705 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541659.21d812586195e63e542da296d685eaac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:12:21,706 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 21d812586195e63e542da296d685eaac, disabling compactions & flushes 2023-07-17 13:12:21,706 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541659.21d812586195e63e542da296d685eaac. 2023-07-17 13:12:21,706 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541659.21d812586195e63e542da296d685eaac. 2023-07-17 13:12:21,706 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541659.21d812586195e63e542da296d685eaac. after waiting 0 ms 2023-07-17 13:12:21,706 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541659.21d812586195e63e542da296d685eaac. 2023-07-17 13:12:21,706 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541659.21d812586195e63e542da296d685eaac. 2023-07-17 13:12:21,706 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 21d812586195e63e542da296d685eaac: 2023-07-17 13:12:21,708 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599541659.9cdaa742d914cd7e269c831fe220a0fa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:12:21,709 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 9cdaa742d914cd7e269c831fe220a0fa, disabling compactions & flushes 2023-07-17 13:12:21,709 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599541659.9cdaa742d914cd7e269c831fe220a0fa. 2023-07-17 13:12:21,709 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599541659.9cdaa742d914cd7e269c831fe220a0fa. 2023-07-17 13:12:21,709 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599541659.9cdaa742d914cd7e269c831fe220a0fa. after waiting 0 ms 2023-07-17 13:12:21,709 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599541659.9cdaa742d914cd7e269c831fe220a0fa. 2023-07-17 13:12:21,709 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599541659.9cdaa742d914cd7e269c831fe220a0fa. 2023-07-17 13:12:21,709 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 9cdaa742d914cd7e269c831fe220a0fa: 2023-07-17 13:12:21,721 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 13:12:21,723 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541659.21d812586195e63e542da296d685eaac.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689599541722"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599541722"}]},"ts":"1689599541722"} 2023-07-17 13:12:21,723 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599541659.9cdaa742d914cd7e269c831fe220a0fa.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689599541722"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599541722"}]},"ts":"1689599541722"} 2023-07-17 13:12:21,725 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 13:12:21,727 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 13:12:21,727 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599541727"}]},"ts":"1689599541727"} 2023-07-17 13:12:21,728 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-17 13:12:21,732 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 13:12:21,733 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 13:12:21,733 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 13:12:21,733 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 13:12:21,733 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 13:12:21,733 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=21d812586195e63e542da296d685eaac, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9cdaa742d914cd7e269c831fe220a0fa, ASSIGN}] 2023-07-17 13:12:21,737 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9cdaa742d914cd7e269c831fe220a0fa, ASSIGN 2023-07-17 13:12:21,737 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=21d812586195e63e542da296d685eaac, ASSIGN 2023-07-17 13:12:21,738 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=21d812586195e63e542da296d685eaac, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42601,1689599458269; forceNewPlan=false, retain=false 2023-07-17 13:12:21,739 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9cdaa742d914cd7e269c831fe220a0fa, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43575,1689599458131; forceNewPlan=false, retain=false 2023-07-17 13:12:21,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-17 13:12:21,889 INFO [jenkins-hbase4:44069] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 13:12:21,892 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=9cdaa742d914cd7e269c831fe220a0fa, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:21,892 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=21d812586195e63e542da296d685eaac, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:21,892 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599541659.9cdaa742d914cd7e269c831fe220a0fa.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689599541892"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599541892"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599541892"}]},"ts":"1689599541892"} 2023-07-17 13:12:21,892 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541659.21d812586195e63e542da296d685eaac.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689599541892"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599541892"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599541892"}]},"ts":"1689599541892"} 2023-07-17 13:12:21,897 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 9cdaa742d914cd7e269c831fe220a0fa, server=jenkins-hbase4.apache.org,43575,1689599458131}] 2023-07-17 13:12:21,899 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure 21d812586195e63e542da296d685eaac, server=jenkins-hbase4.apache.org,42601,1689599458269}] 2023-07-17 13:12:21,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-17 13:12:22,059 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599541659.9cdaa742d914cd7e269c831fe220a0fa. 2023-07-17 13:12:22,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9cdaa742d914cd7e269c831fe220a0fa, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599541659.9cdaa742d914cd7e269c831fe220a0fa.', STARTKEY => '2', ENDKEY => ''} 2023-07-17 13:12:22,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599541659.9cdaa742d914cd7e269c831fe220a0fa. service=AccessControlService 2023-07-17 13:12:22,060 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541659.21d812586195e63e542da296d685eaac. 2023-07-17 13:12:22,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 21d812586195e63e542da296d685eaac, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541659.21d812586195e63e542da296d685eaac.', STARTKEY => '', ENDKEY => '2'} 2023-07-17 13:12:22,060 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 13:12:22,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 9cdaa742d914cd7e269c831fe220a0fa 2023-07-17 13:12:22,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541659.21d812586195e63e542da296d685eaac. service=AccessControlService 2023-07-17 13:12:22,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599541659.9cdaa742d914cd7e269c831fe220a0fa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:12:22,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9cdaa742d914cd7e269c831fe220a0fa 2023-07-17 13:12:22,060 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 13:12:22,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9cdaa742d914cd7e269c831fe220a0fa 2023-07-17 13:12:22,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 21d812586195e63e542da296d685eaac 2023-07-17 13:12:22,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541659.21d812586195e63e542da296d685eaac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:12:22,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 21d812586195e63e542da296d685eaac 2023-07-17 13:12:22,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 21d812586195e63e542da296d685eaac 2023-07-17 13:12:22,062 INFO [StoreOpener-9cdaa742d914cd7e269c831fe220a0fa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9cdaa742d914cd7e269c831fe220a0fa 2023-07-17 13:12:22,062 INFO [StoreOpener-21d812586195e63e542da296d685eaac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 21d812586195e63e542da296d685eaac 2023-07-17 13:12:22,064 DEBUG [StoreOpener-9cdaa742d914cd7e269c831fe220a0fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9cdaa742d914cd7e269c831fe220a0fa/cf 2023-07-17 13:12:22,064 DEBUG [StoreOpener-9cdaa742d914cd7e269c831fe220a0fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9cdaa742d914cd7e269c831fe220a0fa/cf 2023-07-17 13:12:22,064 DEBUG [StoreOpener-21d812586195e63e542da296d685eaac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/21d812586195e63e542da296d685eaac/cf 2023-07-17 13:12:22,064 DEBUG [StoreOpener-21d812586195e63e542da296d685eaac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/21d812586195e63e542da296d685eaac/cf 2023-07-17 13:12:22,064 INFO [StoreOpener-9cdaa742d914cd7e269c831fe220a0fa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9cdaa742d914cd7e269c831fe220a0fa columnFamilyName cf 2023-07-17 13:12:22,064 INFO [StoreOpener-21d812586195e63e542da296d685eaac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 21d812586195e63e542da296d685eaac columnFamilyName cf 2023-07-17 13:12:22,065 INFO [StoreOpener-9cdaa742d914cd7e269c831fe220a0fa-1] regionserver.HStore(310): Store=9cdaa742d914cd7e269c831fe220a0fa/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:12:22,065 INFO [StoreOpener-21d812586195e63e542da296d685eaac-1] regionserver.HStore(310): Store=21d812586195e63e542da296d685eaac/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:12:22,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9cdaa742d914cd7e269c831fe220a0fa 2023-07-17 13:12:22,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/21d812586195e63e542da296d685eaac 2023-07-17 13:12:22,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9cdaa742d914cd7e269c831fe220a0fa 2023-07-17 13:12:22,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/21d812586195e63e542da296d685eaac 2023-07-17 13:12:22,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 21d812586195e63e542da296d685eaac 2023-07-17 13:12:22,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9cdaa742d914cd7e269c831fe220a0fa 2023-07-17 13:12:22,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/21d812586195e63e542da296d685eaac/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 13:12:22,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9cdaa742d914cd7e269c831fe220a0fa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 13:12:22,075 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9cdaa742d914cd7e269c831fe220a0fa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65197740, jitterRate=-0.028477966785430908}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 13:12:22,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9cdaa742d914cd7e269c831fe220a0fa: 2023-07-17 13:12:22,076 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599541659.9cdaa742d914cd7e269c831fe220a0fa., pid=69, masterSystemTime=1689599542051 2023-07-17 13:12:22,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599541659.9cdaa742d914cd7e269c831fe220a0fa. 2023-07-17 13:12:22,077 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599541659.9cdaa742d914cd7e269c831fe220a0fa. 2023-07-17 13:12:22,078 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 21d812586195e63e542da296d685eaac; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60689806, jitterRate=-0.09565141797065735}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 13:12:22,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 21d812586195e63e542da296d685eaac: 2023-07-17 13:12:22,078 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=9cdaa742d914cd7e269c831fe220a0fa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:22,079 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599541659.9cdaa742d914cd7e269c831fe220a0fa.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689599542078"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689599542078"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689599542078"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689599542078"}]},"ts":"1689599542078"} 2023-07-17 13:12:22,079 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541659.21d812586195e63e542da296d685eaac., pid=70, masterSystemTime=1689599542052 2023-07-17 13:12:22,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541659.21d812586195e63e542da296d685eaac. 2023-07-17 13:12:22,081 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541659.21d812586195e63e542da296d685eaac. 2023-07-17 13:12:22,081 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=21d812586195e63e542da296d685eaac, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:22,082 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541659.21d812586195e63e542da296d685eaac.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689599542081"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689599542081"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689599542081"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689599542081"}]},"ts":"1689599542081"} 2023-07-17 13:12:22,084 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-17 13:12:22,084 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 9cdaa742d914cd7e269c831fe220a0fa, server=jenkins-hbase4.apache.org,43575,1689599458131 in 183 msec 2023-07-17 13:12:22,085 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9cdaa742d914cd7e269c831fe220a0fa, ASSIGN in 351 msec 2023-07-17 13:12:22,087 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-17 13:12:22,087 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure 21d812586195e63e542da296d685eaac, server=jenkins-hbase4.apache.org,42601,1689599458269 in 186 msec 2023-07-17 13:12:22,090 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-17 13:12:22,090 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=21d812586195e63e542da296d685eaac, ASSIGN in 354 msec 2023-07-17 13:12:22,091 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 13:12:22,091 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599542091"}]},"ts":"1689599542091"} 2023-07-17 13:12:22,093 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-17 13:12:22,097 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 13:12:22,097 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-17 13:12:22,101 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43575] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-17 13:12:22,103 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:22,103 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:22,103 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:22,103 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:22,105 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:22,105 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:22,105 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:22,105 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:22,105 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:22,106 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:22,106 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:22,106 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:22,107 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 446 msec 2023-07-17 13:12:22,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-17 13:12:22,268 INFO [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-17 13:12:22,296 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 21d812586195e63e542da296d685eaac, 9cdaa742d914cd7e269c831fe220a0fa 2023-07-17 13:12:22,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[21d812586195e63e542da296d685eaac, 9cdaa742d914cd7e269c831fe220a0fa], force=true 2023-07-17 13:12:22,316 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[21d812586195e63e542da296d685eaac, 9cdaa742d914cd7e269c831fe220a0fa], force=true 2023-07-17 13:12:22,316 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[21d812586195e63e542da296d685eaac, 9cdaa742d914cd7e269c831fe220a0fa], force=true 2023-07-17 13:12:22,316 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[21d812586195e63e542da296d685eaac, 9cdaa742d914cd7e269c831fe220a0fa], force=true 2023-07-17 13:12:22,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-17 13:12:22,343 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=21d812586195e63e542da296d685eaac, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9cdaa742d914cd7e269c831fe220a0fa, UNASSIGN}] 2023-07-17 13:12:22,346 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=21d812586195e63e542da296d685eaac, UNASSIGN 2023-07-17 13:12:22,346 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9cdaa742d914cd7e269c831fe220a0fa, UNASSIGN 2023-07-17 13:12:22,346 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=9cdaa742d914cd7e269c831fe220a0fa, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:22,347 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=21d812586195e63e542da296d685eaac, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:22,347 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599541659.9cdaa742d914cd7e269c831fe220a0fa.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689599542346"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599542346"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599542346"}]},"ts":"1689599542346"} 2023-07-17 13:12:22,347 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541659.21d812586195e63e542da296d685eaac.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689599542346"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599542346"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599542346"}]},"ts":"1689599542346"} 2023-07-17 13:12:22,348 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure 9cdaa742d914cd7e269c831fe220a0fa, server=jenkins-hbase4.apache.org,43575,1689599458131}] 2023-07-17 13:12:22,349 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure 21d812586195e63e542da296d685eaac, server=jenkins-hbase4.apache.org,42601,1689599458269}] 2023-07-17 13:12:22,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-17 13:12:22,496 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467386_0004_000001 (auth:SIMPLE) 2023-07-17 13:12:22,501 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9cdaa742d914cd7e269c831fe220a0fa 2023-07-17 13:12:22,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9cdaa742d914cd7e269c831fe220a0fa, disabling compactions & flushes 2023-07-17 13:12:22,503 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 21d812586195e63e542da296d685eaac 2023-07-17 13:12:22,503 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599541659.9cdaa742d914cd7e269c831fe220a0fa. 2023-07-17 13:12:22,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599541659.9cdaa742d914cd7e269c831fe220a0fa. 2023-07-17 13:12:22,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599541659.9cdaa742d914cd7e269c831fe220a0fa. after waiting 0 ms 2023-07-17 13:12:22,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599541659.9cdaa742d914cd7e269c831fe220a0fa. 2023-07-17 13:12:22,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 21d812586195e63e542da296d685eaac, disabling compactions & flushes 2023-07-17 13:12:22,515 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 9cdaa742d914cd7e269c831fe220a0fa 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-17 13:12:22,515 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541659.21d812586195e63e542da296d685eaac. 2023-07-17 13:12:22,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541659.21d812586195e63e542da296d685eaac. 2023-07-17 13:12:22,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541659.21d812586195e63e542da296d685eaac. after waiting 0 ms 2023-07-17 13:12:22,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541659.21d812586195e63e542da296d685eaac. 2023-07-17 13:12:22,515 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 21d812586195e63e542da296d685eaac 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-17 13:12:22,555 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9cdaa742d914cd7e269c831fe220a0fa/.tmp/cf/ca356860a3e64ac29dd2e129cfba87ab 2023-07-17 13:12:22,559 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/21d812586195e63e542da296d685eaac/.tmp/cf/5c56aa38da94425e9d21b4968127d7e9 2023-07-17 13:12:22,567 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9cdaa742d914cd7e269c831fe220a0fa/.tmp/cf/ca356860a3e64ac29dd2e129cfba87ab as hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9cdaa742d914cd7e269c831fe220a0fa/cf/ca356860a3e64ac29dd2e129cfba87ab 2023-07-17 13:12:22,568 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/21d812586195e63e542da296d685eaac/.tmp/cf/5c56aa38da94425e9d21b4968127d7e9 as hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/21d812586195e63e542da296d685eaac/cf/5c56aa38da94425e9d21b4968127d7e9 2023-07-17 13:12:22,574 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/21d812586195e63e542da296d685eaac/cf/5c56aa38da94425e9d21b4968127d7e9, entries=1, sequenceid=5, filesize=4.7 K 2023-07-17 13:12:22,575 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 21d812586195e63e542da296d685eaac in 60ms, sequenceid=5, compaction requested=false 2023-07-17 13:12:22,575 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-17 13:12:22,581 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9cdaa742d914cd7e269c831fe220a0fa/cf/ca356860a3e64ac29dd2e129cfba87ab, entries=1, sequenceid=5, filesize=4.7 K 2023-07-17 13:12:22,582 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 9cdaa742d914cd7e269c831fe220a0fa in 67ms, sequenceid=5, compaction requested=false 2023-07-17 13:12:22,588 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/21d812586195e63e542da296d685eaac/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-17 13:12:22,591 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:12:22,592 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541659.21d812586195e63e542da296d685eaac. 2023-07-17 13:12:22,592 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 21d812586195e63e542da296d685eaac: 2023-07-17 13:12:22,593 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 21d812586195e63e542da296d685eaac 2023-07-17 13:12:22,594 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=21d812586195e63e542da296d685eaac, regionState=CLOSED 2023-07-17 13:12:22,594 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541659.21d812586195e63e542da296d685eaac.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689599542594"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599542594"}]},"ts":"1689599542594"} 2023-07-17 13:12:22,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9cdaa742d914cd7e269c831fe220a0fa/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-17 13:12:22,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:12:22,596 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599541659.9cdaa742d914cd7e269c831fe220a0fa. 2023-07-17 13:12:22,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9cdaa742d914cd7e269c831fe220a0fa: 2023-07-17 13:12:22,598 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9cdaa742d914cd7e269c831fe220a0fa 2023-07-17 13:12:22,598 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=72 2023-07-17 13:12:22,598 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure 21d812586195e63e542da296d685eaac, server=jenkins-hbase4.apache.org,42601,1689599458269 in 247 msec 2023-07-17 13:12:22,598 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=9cdaa742d914cd7e269c831fe220a0fa, regionState=CLOSED 2023-07-17 13:12:22,599 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599541659.9cdaa742d914cd7e269c831fe220a0fa.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689599542598"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599542598"}]},"ts":"1689599542598"} 2023-07-17 13:12:22,599 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=21d812586195e63e542da296d685eaac, UNASSIGN in 259 msec 2023-07-17 13:12:22,602 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-17 13:12:22,602 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure 9cdaa742d914cd7e269c831fe220a0fa, server=jenkins-hbase4.apache.org,43575,1689599458131 in 252 msec 2023-07-17 13:12:22,603 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-17 13:12:22,603 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9cdaa742d914cd7e269c831fe220a0fa, UNASSIGN in 259 msec 2023-07-17 13:12:22,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-17 13:12:22,664 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3a26239fedc7300320fc523629efb110/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-17 13:12:22,673 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541659.21d812586195e63e542da296d685eaac.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-17 13:12:22,673 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599541659.9cdaa742d914cd7e269c831fe220a0fa.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-17 13:12:22,673 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541660.3a26239fedc7300320fc523629efb110.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-17 13:12:22,737 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3a26239fedc7300320fc523629efb110, ASSIGN}] 2023-07-17 13:12:22,739 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3a26239fedc7300320fc523629efb110, ASSIGN 2023-07-17 13:12:22,740 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3a26239fedc7300320fc523629efb110, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,42601,1689599458269; forceNewPlan=false, retain=false 2023-07-17 13:12:22,890 INFO [jenkins-hbase4:44069] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-17 13:12:22,892 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=3a26239fedc7300320fc523629efb110, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:22,893 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541660.3a26239fedc7300320fc523629efb110.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689599542892"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599542892"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599542892"}]},"ts":"1689599542892"} 2023-07-17 13:12:22,900 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 3a26239fedc7300320fc523629efb110, server=jenkins-hbase4.apache.org,42601,1689599458269}] 2023-07-17 13:12:22,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-17 13:12:23,057 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541660.3a26239fedc7300320fc523629efb110. 2023-07-17 13:12:23,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3a26239fedc7300320fc523629efb110, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541660.3a26239fedc7300320fc523629efb110.', STARTKEY => '', ENDKEY => ''} 2023-07-17 13:12:23,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541660.3a26239fedc7300320fc523629efb110. service=AccessControlService 2023-07-17 13:12:23,058 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 13:12:23,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 3a26239fedc7300320fc523629efb110 2023-07-17 13:12:23,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541660.3a26239fedc7300320fc523629efb110.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:12:23,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3a26239fedc7300320fc523629efb110 2023-07-17 13:12:23,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3a26239fedc7300320fc523629efb110 2023-07-17 13:12:23,060 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3a26239fedc7300320fc523629efb110/.regioninfo 2023-07-17 13:12:23,079 INFO [StoreOpener-3a26239fedc7300320fc523629efb110-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3a26239fedc7300320fc523629efb110 2023-07-17 13:12:23,080 DEBUG [StoreOpener-3a26239fedc7300320fc523629efb110-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3a26239fedc7300320fc523629efb110/cf 2023-07-17 13:12:23,080 DEBUG [StoreOpener-3a26239fedc7300320fc523629efb110-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3a26239fedc7300320fc523629efb110/cf 2023-07-17 13:12:23,081 INFO [StoreOpener-3a26239fedc7300320fc523629efb110-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3a26239fedc7300320fc523629efb110 columnFamilyName cf 2023-07-17 13:12:23,116 DEBUG [StoreOpener-3a26239fedc7300320fc523629efb110-1] regionserver.HStore(539): loaded hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3a26239fedc7300320fc523629efb110/cf/5c56aa38da94425e9d21b4968127d7e9.21d812586195e63e542da296d685eaac->hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/21d812586195e63e542da296d685eaac/cf/5c56aa38da94425e9d21b4968127d7e9-top 2023-07-17 13:12:23,126 DEBUG [StoreOpener-3a26239fedc7300320fc523629efb110-1] regionserver.HStore(539): loaded hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3a26239fedc7300320fc523629efb110/cf/ca356860a3e64ac29dd2e129cfba87ab.9cdaa742d914cd7e269c831fe220a0fa->hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9cdaa742d914cd7e269c831fe220a0fa/cf/ca356860a3e64ac29dd2e129cfba87ab-top 2023-07-17 13:12:23,127 INFO [StoreOpener-3a26239fedc7300320fc523629efb110-1] regionserver.HStore(310): Store=3a26239fedc7300320fc523629efb110/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:12:23,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3a26239fedc7300320fc523629efb110 2023-07-17 13:12:23,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3a26239fedc7300320fc523629efb110 2023-07-17 13:12:23,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3a26239fedc7300320fc523629efb110 2023-07-17 13:12:23,137 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3a26239fedc7300320fc523629efb110; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72099898, jitterRate=0.07437220215797424}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 13:12:23,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3a26239fedc7300320fc523629efb110: 2023-07-17 13:12:23,138 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541660.3a26239fedc7300320fc523629efb110., pid=77, masterSystemTime=1689599543053 2023-07-17 13:12:23,138 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541660.3a26239fedc7300320fc523629efb110.,because compaction is disabled. 2023-07-17 13:12:23,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541660.3a26239fedc7300320fc523629efb110. 2023-07-17 13:12:23,140 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541660.3a26239fedc7300320fc523629efb110. 2023-07-17 13:12:23,141 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=3a26239fedc7300320fc523629efb110, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:23,141 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541660.3a26239fedc7300320fc523629efb110.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689599543141"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689599543141"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689599543141"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689599543141"}]},"ts":"1689599543141"} 2023-07-17 13:12:23,155 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-17 13:12:23,155 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 3a26239fedc7300320fc523629efb110, server=jenkins-hbase4.apache.org,42601,1689599458269 in 242 msec 2023-07-17 13:12:23,157 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-17 13:12:23,157 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3a26239fedc7300320fc523629efb110, ASSIGN in 418 msec 2023-07-17 13:12:23,162 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[21d812586195e63e542da296d685eaac, 9cdaa742d914cd7e269c831fe220a0fa], force=true in 857 msec 2023-07-17 13:12:23,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-17 13:12:23,432 INFO [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-17 13:12:23,439 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-17 13:12:23,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689599543439 (current time:1689599543439). 2023-07-17 13:12:23,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 13:12:23,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(139): Connect 0x0ea35ba6 to 127.0.0.1:56233 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:12:23,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@30512f1e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:12:23,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:12:23,522 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54406, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:12:23,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0ea35ba6 to 127.0.0.1:56233 2023-07-17 13:12:23,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:12:23,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(139): Connect 0x75c60f22 to 127.0.0.1:56233 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:12:23,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61ac0457, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:12:23,604 DEBUG [hconnection-0x58bceea3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:12:23,609 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54408, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:12:23,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:12:23,617 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33390, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:12:23,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x75c60f22 to 127.0.0.1:56233 2023-07-17 13:12:23,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:12:23,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-17 13:12:23,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 13:12:23,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-17 13:12:23,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-17 13:12:23,623 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-17 13:12:23,624 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689600143624 2023-07-17 13:12:23,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-17 13:12:23,624 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,628 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 13:12:23,628 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 13:12:23,633 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-17 13:12:23,635 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-17 13:12:23,636 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 12 msec 2023-07-17 13:12:23,637 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-17 13:12:23,637 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689600143637 2023-07-17 13:12:23,670 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,671 INFO [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-17 13:12:23,671 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:23,672 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-17 13:12:23,673 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-17 13:12:23,673 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,673 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,675 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:23,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:23,675 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:23,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:23,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:23,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:23,675 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:23,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,676 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:23,676 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 13:12:23,676 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,676 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-17 13:12:23,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,676 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:23,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:23,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:23,677 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-17 13:12:23,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-17 13:12:23,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,677 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,677 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-17 13:12:23,677 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-17 13:12:23,677 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:23,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,678 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-17 13:12:23,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,678 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-17 13:12:23,679 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,679 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-17 13:12:23,679 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:23,686 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-17 13:12:23,686 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,686 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-17 13:12:23,686 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-17 13:12:23,686 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:23,686 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-17 13:12:23,688 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-17 13:12:23,686 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42601,1689599458269' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-17 13:12:23,688 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-17 13:12:23,688 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45883,1689599458200' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-17 13:12:23,688 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-17 13:12:23,688 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43575,1689599458131' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-17 13:12:23,690 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:23,690 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:23,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:23,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:23,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:23,692 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:23,693 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,693 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:12:23,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:23,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:23,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:23,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:23,695 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42601,1689599458269' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-17 13:12:23,696 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53621b3c[Count = 0] remaining members to acquire global barrier 2023-07-17 13:12:23,696 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-17 13:12:23,696 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,697 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,697 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-17 13:12:23,697 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-17 13:12:23,697 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,45883,1689599458200' in zk 2023-07-17 13:12:23,697 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:23,697 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 13:12:23,699 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,699 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,699 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:12:23,699 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,699 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-17 13:12:23,699 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:12:23,699 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] zookeeper.ZKUtil(162): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,699 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,701 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:12:23,699 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-17 13:12:23,701 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-17 13:12:23,701 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-17 13:12:23,701 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-17 13:12:23,701 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,43575,1689599458131' in zk 2023-07-17 13:12:23,702 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:12:23,703 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:12:23,703 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541660.3a26239fedc7300320fc523629efb110. 2023-07-17 13:12:23,703 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541660.3a26239fedc7300320fc523629efb110. started... 2023-07-17 13:12:23,703 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-17 13:12:23,703 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:12:23,703 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-17 13:12:23,707 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3a26239fedc7300320fc523629efb110: 2023-07-17 13:12:23,707 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541660.3a26239fedc7300320fc523629efb110.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,707 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:12:23,707 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3a26239fedc7300320fc523629efb110/cf/5c56aa38da94425e9d21b4968127d7e9.21d812586195e63e542da296d685eaac->hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/21d812586195e63e542da296d685eaac/cf/5c56aa38da94425e9d21b4968127d7e9-top, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3a26239fedc7300320fc523629efb110/cf/ca356860a3e64ac29dd2e129cfba87ab.9cdaa742d914cd7e269c831fe220a0fa->hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9cdaa742d914cd7e269c831fe220a0fa/cf/ca356860a3e64ac29dd2e129cfba87ab-top] hfiles 2023-07-17 13:12:23,707 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3a26239fedc7300320fc523629efb110/cf/5c56aa38da94425e9d21b4968127d7e9.21d812586195e63e542da296d685eaac for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,711 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3a26239fedc7300320fc523629efb110/cf/ca356860a3e64ac29dd2e129cfba87ab.9cdaa742d914cd7e269c831fe220a0fa for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,728 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:12:23,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-17 13:12:23,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-17 13:12:23,730 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 13:12:23,765 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541660.3a26239fedc7300320fc523629efb110. completed. 2023-07-17 13:12:23,765 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541660.3a26239fedc7300320fc523629efb110. 2023-07-17 13:12:23,765 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:12:23,766 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:12:23,766 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:23,766 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-17 13:12:23,766 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,42601,1689599458269' in zk 2023-07-17 13:12:23,773 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-17 13:12:23,773 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:12:23,773 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-17 13:12:23,773 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:23,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:23,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:23,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:23,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:23,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:23,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:23,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:23,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:23,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:23,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:23,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:23,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:23,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,42601,1689599458269': 2023-07-17 13:12:23,784 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42601,1689599458269' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-17 13:12:23,784 INFO [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-17 13:12:23,784 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 13:12:23,784 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 13:12:23,784 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,784 INFO [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 13:12:23,786 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,786 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,786 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,786 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:23,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:23,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:23,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,786 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:23,786 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,786 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:23,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:23,787 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:23,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:23,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:23,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:23,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:23,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:23,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:23,788 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:23,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:23,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,789 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:23,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:23,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:23,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:23,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:23,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,791 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:23,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:23,791 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:23,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:23,794 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:23,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:23,808 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:23,808 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:23,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:23,808 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,808 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:23,808 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:23,808 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:23,809 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:23,809 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,808 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:23,809 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:23,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:23,809 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:12:23,809 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:23,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:23,809 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:23,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:23,809 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:23,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:23,810 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:23,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:23,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:23,809 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,810 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:23,810 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,810 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:23,810 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:23,810 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,810 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:23,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:23,864 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,930 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:12:23,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-17 13:12:23,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-17 13:12:23,932 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 13:12:23,934 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-17 13:12:23,934 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,935 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,935 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689599543624Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689599543809 (+185 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689599543809Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689599543815 (+6 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689599543843 (+28 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689599543934 (+91 ms) 2023-07-17 13:12:23,938 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-17 13:12:23,940 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 310 msec 2023-07-17 13:12:24,042 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 13:12:24,232 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:12:24,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-17 13:12:24,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 13:12:24,234 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599544234 2023-07-17 13:12:24,234 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37401, tgtDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599544234, rawTgtDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599544234, srcFsUri=hdfs://localhost:37401, srcDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b 2023-07-17 13:12:24,264 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37401, inputRoot=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b 2023-07-17 13:12:24,264 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-796463550_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599544234, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599544234/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:24,264 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37401, inputRoot=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b, snapshotDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-17 13:12:24,277 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599544234/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:24,328 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:24,329 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:24,329 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:24,330 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:25,464 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/hadoop-6398482052524750642.jar 2023-07-17 13:12:25,465 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:25,465 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:25,547 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/hadoop-7264592714362325873.jar 2023-07-17 13:12:25,548 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:25,548 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:25,549 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:25,549 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:25,550 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:25,550 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:25,551 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 13:12:25,551 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 13:12:25,552 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 13:12:25,553 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 13:12:25,553 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 13:12:25,554 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 13:12:25,554 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 13:12:25,555 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 13:12:25,555 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 13:12:25,556 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 13:12:25,556 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:12:25,557 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:12:25,558 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 13:12:25,558 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:12:25,558 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:12:25,559 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 13:12:25,560 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 13:12:26,751 WARN [Listener at jenkins-hbase4.apache.org/38153] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 13:12:26,755 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-17 13:12:26,757 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-17 13:12:26,942 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 13:12:26,942 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 13:12:27,524 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467386_0005_000001 (auth:SIMPLE) 2023-07-17 13:12:33,470 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467386_0005_000001 (auth:SIMPLE) 2023-07-17 13:12:35,834 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467386_0005_000001 (auth:SIMPLE) 2023-07-17 13:12:40,984 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467386_0005_000001 (auth:SIMPLE) 2023-07-17 13:12:42,136 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 13:12:42,139 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 13:12:42,155 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:42,155 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 13:12:42,155 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 13:12:42,156 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-233758021_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:42,156 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(367): hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-17 13:12:42,156 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(367): hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-17 13:12:42,156 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-233758021_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599544234/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599544234/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:42,157 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(367): hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599544234/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-17 13:12:42,157 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(367): hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599544234/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-17 13:12:42,164 INFO [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:42,165 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:42,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:42,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-17 13:12:42,169 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599562169"}]},"ts":"1689599562169"} 2023-07-17 13:12:42,170 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-17 13:12:42,172 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-17 13:12:42,172 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3a26239fedc7300320fc523629efb110, UNASSIGN}] 2023-07-17 13:12:42,174 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3a26239fedc7300320fc523629efb110, UNASSIGN 2023-07-17 13:12:42,175 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=3a26239fedc7300320fc523629efb110, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:42,175 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541660.3a26239fedc7300320fc523629efb110.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689599562175"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599562175"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599562175"}]},"ts":"1689599562175"} 2023-07-17 13:12:42,176 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 3a26239fedc7300320fc523629efb110, server=jenkins-hbase4.apache.org,42601,1689599458269}] 2023-07-17 13:12:42,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-17 13:12:42,328 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3a26239fedc7300320fc523629efb110 2023-07-17 13:12:42,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3a26239fedc7300320fc523629efb110, disabling compactions & flushes 2023-07-17 13:12:42,329 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541660.3a26239fedc7300320fc523629efb110. 2023-07-17 13:12:42,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541660.3a26239fedc7300320fc523629efb110. 2023-07-17 13:12:42,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541660.3a26239fedc7300320fc523629efb110. after waiting 0 ms 2023-07-17 13:12:42,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541660.3a26239fedc7300320fc523629efb110. 2023-07-17 13:12:42,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3a26239fedc7300320fc523629efb110/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-17 13:12:42,342 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:12:42,343 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541660.3a26239fedc7300320fc523629efb110. 2023-07-17 13:12:42,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3a26239fedc7300320fc523629efb110: 2023-07-17 13:12:42,345 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3a26239fedc7300320fc523629efb110 2023-07-17 13:12:42,345 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=3a26239fedc7300320fc523629efb110, regionState=CLOSED 2023-07-17 13:12:42,345 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541660.3a26239fedc7300320fc523629efb110.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689599562345"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599562345"}]},"ts":"1689599562345"} 2023-07-17 13:12:42,348 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-17 13:12:42,348 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 3a26239fedc7300320fc523629efb110, server=jenkins-hbase4.apache.org,42601,1689599458269 in 171 msec 2023-07-17 13:12:42,350 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-17 13:12:42,350 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3a26239fedc7300320fc523629efb110, UNASSIGN in 176 msec 2023-07-17 13:12:42,351 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599562351"}]},"ts":"1689599562351"} 2023-07-17 13:12:42,352 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-17 13:12:42,354 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-17 13:12:42,355 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 189 msec 2023-07-17 13:12:42,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-17 13:12:42,472 INFO [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-17 13:12:42,472 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:42,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:42,476 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:42,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:42,477 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:42,478 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43575] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:42,482 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3a26239fedc7300320fc523629efb110 2023-07-17 13:12:42,482 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9cdaa742d914cd7e269c831fe220a0fa 2023-07-17 13:12:42,482 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/21d812586195e63e542da296d685eaac 2023-07-17 13:12:42,484 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:42,484 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:42,484 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9cdaa742d914cd7e269c831fe220a0fa/cf, FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9cdaa742d914cd7e269c831fe220a0fa/recovered.edits] 2023-07-17 13:12:42,485 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3a26239fedc7300320fc523629efb110/cf, FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3a26239fedc7300320fc523629efb110/recovered.edits] 2023-07-17 13:12:42,485 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/21d812586195e63e542da296d685eaac/cf, FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/21d812586195e63e542da296d685eaac/recovered.edits] 2023-07-17 13:12:42,486 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:42,487 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:42,487 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-17 13:12:42,487 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-17 13:12:42,487 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-17 13:12:42,487 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-17 13:12:42,491 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:42,491 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:42,491 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:42,491 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:42,491 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:42,491 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9cdaa742d914cd7e269c831fe220a0fa/cf/ca356860a3e64ac29dd2e129cfba87ab to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9cdaa742d914cd7e269c831fe220a0fa/cf/ca356860a3e64ac29dd2e129cfba87ab 2023-07-17 13:12:42,491 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:42,491 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:42,491 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:42,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-17 13:12:42,492 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3a26239fedc7300320fc523629efb110/cf/5c56aa38da94425e9d21b4968127d7e9.21d812586195e63e542da296d685eaac to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3a26239fedc7300320fc523629efb110/cf/5c56aa38da94425e9d21b4968127d7e9.21d812586195e63e542da296d685eaac 2023-07-17 13:12:42,494 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:42,494 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:42,494 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:42,494 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/21d812586195e63e542da296d685eaac/cf/5c56aa38da94425e9d21b4968127d7e9 to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/21d812586195e63e542da296d685eaac/cf/5c56aa38da94425e9d21b4968127d7e9 2023-07-17 13:12:42,495 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:42,496 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3a26239fedc7300320fc523629efb110/cf/ca356860a3e64ac29dd2e129cfba87ab.9cdaa742d914cd7e269c831fe220a0fa to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3a26239fedc7300320fc523629efb110/cf/ca356860a3e64ac29dd2e129cfba87ab.9cdaa742d914cd7e269c831fe220a0fa 2023-07-17 13:12:42,497 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9cdaa742d914cd7e269c831fe220a0fa/recovered.edits/8.seqid to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9cdaa742d914cd7e269c831fe220a0fa/recovered.edits/8.seqid 2023-07-17 13:12:42,497 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9cdaa742d914cd7e269c831fe220a0fa 2023-07-17 13:12:42,500 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/21d812586195e63e542da296d685eaac/recovered.edits/8.seqid to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/21d812586195e63e542da296d685eaac/recovered.edits/8.seqid 2023-07-17 13:12:42,500 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/21d812586195e63e542da296d685eaac 2023-07-17 13:12:42,502 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3a26239fedc7300320fc523629efb110/recovered.edits/12.seqid to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3a26239fedc7300320fc523629efb110/recovered.edits/12.seqid 2023-07-17 13:12:42,503 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3a26239fedc7300320fc523629efb110 2023-07-17 13:12:42,503 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-17 13:12:42,505 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:42,508 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-17 13:12:42,512 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-17 13:12:42,513 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:42,513 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-17 13:12:42,514 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541660.3a26239fedc7300320fc523629efb110.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689599562513"}]},"ts":"9223372036854775807"} 2023-07-17 13:12:42,515 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-17 13:12:42,515 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3a26239fedc7300320fc523629efb110, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689599541660.3a26239fedc7300320fc523629efb110.', STARTKEY => '', ENDKEY => ''}] 2023-07-17 13:12:42,515 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-17 13:12:42,516 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689599562515"}]},"ts":"9223372036854775807"} 2023-07-17 13:12:42,519 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-17 13:12:42,521 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:42,522 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 48 msec 2023-07-17 13:12:42,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-17 13:12:42,594 INFO [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-17 13:12:42,594 INFO [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:42,595 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:42,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:42,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-17 13:12:42,600 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599562600"}]},"ts":"1689599562600"} 2023-07-17 13:12:42,603 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-17 13:12:42,605 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-17 13:12:42,606 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=08902eb27b867f8ee32a529c7fd41186, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=fad2aa5fcc378cfa825646823d2fbe29, UNASSIGN}] 2023-07-17 13:12:42,608 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=08902eb27b867f8ee32a529c7fd41186, UNASSIGN 2023-07-17 13:12:42,608 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=fad2aa5fcc378cfa825646823d2fbe29, UNASSIGN 2023-07-17 13:12:42,609 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=08902eb27b867f8ee32a529c7fd41186, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:42,610 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689599538946.08902eb27b867f8ee32a529c7fd41186.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689599562609"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599562609"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599562609"}]},"ts":"1689599562609"} 2023-07-17 13:12:42,610 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=fad2aa5fcc378cfa825646823d2fbe29, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:42,610 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689599538946.fad2aa5fcc378cfa825646823d2fbe29.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689599562610"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599562610"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599562610"}]},"ts":"1689599562610"} 2023-07-17 13:12:42,616 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure fad2aa5fcc378cfa825646823d2fbe29, server=jenkins-hbase4.apache.org,45883,1689599458200}] 2023-07-17 13:12:42,617 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure 08902eb27b867f8ee32a529c7fd41186, server=jenkins-hbase4.apache.org,43575,1689599458131}] 2023-07-17 13:12:42,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-17 13:12:42,772 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close fad2aa5fcc378cfa825646823d2fbe29 2023-07-17 13:12:42,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fad2aa5fcc378cfa825646823d2fbe29, disabling compactions & flushes 2023-07-17 13:12:42,772 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689599538946.fad2aa5fcc378cfa825646823d2fbe29. 2023-07-17 13:12:42,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689599538946.fad2aa5fcc378cfa825646823d2fbe29. 2023-07-17 13:12:42,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689599538946.fad2aa5fcc378cfa825646823d2fbe29. after waiting 0 ms 2023-07-17 13:12:42,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689599538946.fad2aa5fcc378cfa825646823d2fbe29. 2023-07-17 13:12:42,778 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 08902eb27b867f8ee32a529c7fd41186 2023-07-17 13:12:42,778 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 08902eb27b867f8ee32a529c7fd41186, disabling compactions & flushes 2023-07-17 13:12:42,778 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689599538946.08902eb27b867f8ee32a529c7fd41186. 2023-07-17 13:12:42,778 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689599538946.08902eb27b867f8ee32a529c7fd41186. 2023-07-17 13:12:42,778 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689599538946.08902eb27b867f8ee32a529c7fd41186. after waiting 0 ms 2023-07-17 13:12:42,778 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689599538946.08902eb27b867f8ee32a529c7fd41186. 2023-07-17 13:12:42,797 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion/fad2aa5fcc378cfa825646823d2fbe29/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 13:12:42,798 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithMergeRegion/08902eb27b867f8ee32a529c7fd41186/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 13:12:42,798 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:12:42,799 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689599538946.fad2aa5fcc378cfa825646823d2fbe29. 2023-07-17 13:12:42,799 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fad2aa5fcc378cfa825646823d2fbe29: 2023-07-17 13:12:42,799 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:12:42,800 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689599538946.08902eb27b867f8ee32a529c7fd41186. 2023-07-17 13:12:42,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 08902eb27b867f8ee32a529c7fd41186: 2023-07-17 13:12:42,806 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed fad2aa5fcc378cfa825646823d2fbe29 2023-07-17 13:12:42,808 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=fad2aa5fcc378cfa825646823d2fbe29, regionState=CLOSED 2023-07-17 13:12:42,808 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689599538946.fad2aa5fcc378cfa825646823d2fbe29.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689599562808"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599562808"}]},"ts":"1689599562808"} 2023-07-17 13:12:42,809 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 08902eb27b867f8ee32a529c7fd41186 2023-07-17 13:12:42,809 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=08902eb27b867f8ee32a529c7fd41186, regionState=CLOSED 2023-07-17 13:12:42,809 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689599538946.08902eb27b867f8ee32a529c7fd41186.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689599562809"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599562809"}]},"ts":"1689599562809"} 2023-07-17 13:12:42,815 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-17 13:12:42,815 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure fad2aa5fcc378cfa825646823d2fbe29, server=jenkins-hbase4.apache.org,45883,1689599458200 in 194 msec 2023-07-17 13:12:42,816 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-17 13:12:42,816 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure 08902eb27b867f8ee32a529c7fd41186, server=jenkins-hbase4.apache.org,43575,1689599458131 in 197 msec 2023-07-17 13:12:42,817 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=fad2aa5fcc378cfa825646823d2fbe29, UNASSIGN in 209 msec 2023-07-17 13:12:42,817 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-17 13:12:42,817 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=08902eb27b867f8ee32a529c7fd41186, UNASSIGN in 210 msec 2023-07-17 13:12:42,818 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599562818"}]},"ts":"1689599562818"} 2023-07-17 13:12:42,820 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-17 13:12:42,823 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-17 13:12:42,824 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 228 msec 2023-07-17 13:12:42,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-17 13:12:42,902 INFO [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-17 13:12:42,902 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:42,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:42,906 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:42,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:42,907 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:42,911 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43575] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:42,912 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/08902eb27b867f8ee32a529c7fd41186 2023-07-17 13:12:42,912 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/fad2aa5fcc378cfa825646823d2fbe29 2023-07-17 13:12:42,915 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:42,915 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:42,916 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-17 13:12:42,916 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-17 13:12:42,917 DEBUG [HFileArchiver-16] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/fad2aa5fcc378cfa825646823d2fbe29/cf, FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/fad2aa5fcc378cfa825646823d2fbe29/recovered.edits] 2023-07-17 13:12:42,917 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/08902eb27b867f8ee32a529c7fd41186/cf, FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/08902eb27b867f8ee32a529c7fd41186/recovered.edits] 2023-07-17 13:12:42,917 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:42,917 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:42,917 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-17 13:12:42,919 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:42,919 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-07-17 13:12:42,919 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-17 13:12:42,919 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:42,919 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:42,919 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:42,919 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:42,919 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:42,919 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:42,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-17 13:12:42,924 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/fad2aa5fcc378cfa825646823d2fbe29/cf/b2264397384e49ddbf3f34b658680918 to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/fad2aa5fcc378cfa825646823d2fbe29/cf/b2264397384e49ddbf3f34b658680918 2023-07-17 13:12:42,924 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/08902eb27b867f8ee32a529c7fd41186/cf/9d3b09621adc4497ae4e9b8ce4c57660 to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/08902eb27b867f8ee32a529c7fd41186/cf/9d3b09621adc4497ae4e9b8ce4c57660 2023-07-17 13:12:42,929 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/fad2aa5fcc378cfa825646823d2fbe29/recovered.edits/9.seqid to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/fad2aa5fcc378cfa825646823d2fbe29/recovered.edits/9.seqid 2023-07-17 13:12:42,930 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/08902eb27b867f8ee32a529c7fd41186/recovered.edits/9.seqid to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/08902eb27b867f8ee32a529c7fd41186/recovered.edits/9.seqid 2023-07-17 13:12:42,930 DEBUG [HFileArchiver-16] backup.HFileArchiver(596): Deleted hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/fad2aa5fcc378cfa825646823d2fbe29 2023-07-17 13:12:42,930 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/08902eb27b867f8ee32a529c7fd41186 2023-07-17 13:12:42,931 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-17 13:12:42,933 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:42,937 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-17 13:12:42,940 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-17 13:12:42,942 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:42,942 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-17 13:12:42,942 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689599538946.08902eb27b867f8ee32a529c7fd41186.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689599562942"}]},"ts":"9223372036854775807"} 2023-07-17 13:12:42,942 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689599538946.fad2aa5fcc378cfa825646823d2fbe29.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689599562942"}]},"ts":"9223372036854775807"} 2023-07-17 13:12:42,945 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-17 13:12:42,945 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 08902eb27b867f8ee32a529c7fd41186, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689599538946.08902eb27b867f8ee32a529c7fd41186.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => fad2aa5fcc378cfa825646823d2fbe29, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689599538946.fad2aa5fcc378cfa825646823d2fbe29.', STARTKEY => '1', ENDKEY => ''}] 2023-07-17 13:12:42,945 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-17 13:12:42,945 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689599562945"}]},"ts":"9223372036854775807"} 2023-07-17 13:12:42,948 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-17 13:12:42,952 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:42,958 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 49 msec 2023-07-17 13:12:43,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-17 13:12:43,022 INFO [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-17 13:12:43,032 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-17 13:12:43,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:43,035 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-17 13:12:43,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:43,040 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-17 13:12:43,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:43,073 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=765 (was 748) Potentially hanging thread: Thread-3945 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x12d0e02b-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-233758021_17 at /127.0.0.1:60420 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-233758021_17 at /127.0.0.1:37152 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-233758021_17 at /127.0.0.1:41136 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2110913733) connection to jenkins-hbase4.apache.org/172.31.14.131:41823 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x12d0e02b-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x12d0e02b-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x12d0e02b-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-233758021_17 at /127.0.0.1:37138 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-294176094_1 at /127.0.0.1:37118 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-294176094_1 at /127.0.0.1:60392 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x12d0e02b-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x12d0e02b-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=917 (was 893) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=565 (was 430) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 186), AvailableMemoryMB=2335 (was 2587) 2023-07-17 13:12:43,074 WARN [Listener at jenkins-hbase4.apache.org/38153] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-17 13:12:43,104 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=765, OpenFileDescriptor=917, MaxFileDescriptor=60000, SystemLoadAverage=565, ProcessCount=183, AvailableMemoryMB=2334 2023-07-17 13:12:43,105 WARN [Listener at jenkins-hbase4.apache.org/38153] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-17 13:12:43,107 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-17 13:12:43,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 13:12:43,111 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 13:12:43,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-17 13:12:43,112 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 13:12:43,114 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ef2944a6f2d1ea2d592d623cc763676 2023-07-17 13:12:43,114 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testEmptyExportFileSystemState/9673c9a25a64047b5e8e56c0868ad3b6 2023-07-17 13:12:43,115 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testEmptyExportFileSystemState/9673c9a25a64047b5e8e56c0868ad3b6 empty. 2023-07-17 13:12:43,115 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ef2944a6f2d1ea2d592d623cc763676 empty. 2023-07-17 13:12:43,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-17 13:12:43,116 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testEmptyExportFileSystemState/9673c9a25a64047b5e8e56c0868ad3b6 2023-07-17 13:12:43,116 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ef2944a6f2d1ea2d592d623cc763676 2023-07-17 13:12:43,116 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-17 13:12:43,141 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-17 13:12:43,142 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9673c9a25a64047b5e8e56c0868ad3b6, NAME => 'testtb-testEmptyExportFileSystemState,1,1689599563106.9673c9a25a64047b5e8e56c0868ad3b6.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp 2023-07-17 13:12:43,142 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6ef2944a6f2d1ea2d592d623cc763676, NAME => 'testtb-testEmptyExportFileSystemState,,1689599563106.6ef2944a6f2d1ea2d592d623cc763676.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp 2023-07-17 13:12:43,175 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689599563106.9673c9a25a64047b5e8e56c0868ad3b6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:12:43,175 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 9673c9a25a64047b5e8e56c0868ad3b6, disabling compactions & flushes 2023-07-17 13:12:43,175 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689599563106.9673c9a25a64047b5e8e56c0868ad3b6. 2023-07-17 13:12:43,175 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689599563106.9673c9a25a64047b5e8e56c0868ad3b6. 2023-07-17 13:12:43,175 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689599563106.9673c9a25a64047b5e8e56c0868ad3b6. after waiting 0 ms 2023-07-17 13:12:43,175 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689599563106.9673c9a25a64047b5e8e56c0868ad3b6. 2023-07-17 13:12:43,175 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689599563106.9673c9a25a64047b5e8e56c0868ad3b6. 2023-07-17 13:12:43,175 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 9673c9a25a64047b5e8e56c0868ad3b6: 2023-07-17 13:12:43,183 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689599563106.6ef2944a6f2d1ea2d592d623cc763676.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:12:43,183 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 6ef2944a6f2d1ea2d592d623cc763676, disabling compactions & flushes 2023-07-17 13:12:43,183 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689599563106.6ef2944a6f2d1ea2d592d623cc763676. 2023-07-17 13:12:43,183 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689599563106.6ef2944a6f2d1ea2d592d623cc763676. 2023-07-17 13:12:43,183 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689599563106.6ef2944a6f2d1ea2d592d623cc763676. after waiting 0 ms 2023-07-17 13:12:43,183 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689599563106.6ef2944a6f2d1ea2d592d623cc763676. 2023-07-17 13:12:43,183 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689599563106.6ef2944a6f2d1ea2d592d623cc763676. 2023-07-17 13:12:43,183 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 6ef2944a6f2d1ea2d592d623cc763676: 2023-07-17 13:12:43,186 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 13:12:43,188 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689599563106.9673c9a25a64047b5e8e56c0868ad3b6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689599563188"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599563188"}]},"ts":"1689599563188"} 2023-07-17 13:12:43,189 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689599563106.6ef2944a6f2d1ea2d592d623cc763676.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689599563188"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599563188"}]},"ts":"1689599563188"} 2023-07-17 13:12:43,191 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 13:12:43,192 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 13:12:43,193 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599563192"}]},"ts":"1689599563192"} 2023-07-17 13:12:43,195 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-17 13:12:43,198 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 13:12:43,199 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 13:12:43,199 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 13:12:43,200 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 13:12:43,200 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 13:12:43,200 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6ef2944a6f2d1ea2d592d623cc763676, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=9673c9a25a64047b5e8e56c0868ad3b6, ASSIGN}] 2023-07-17 13:12:43,203 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=9673c9a25a64047b5e8e56c0868ad3b6, ASSIGN 2023-07-17 13:12:43,203 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6ef2944a6f2d1ea2d592d623cc763676, ASSIGN 2023-07-17 13:12:43,204 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6ef2944a6f2d1ea2d592d623cc763676, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45883,1689599458200; forceNewPlan=false, retain=false 2023-07-17 13:12:43,204 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=9673c9a25a64047b5e8e56c0868ad3b6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43575,1689599458131; forceNewPlan=false, retain=false 2023-07-17 13:12:43,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-17 13:12:43,354 INFO [jenkins-hbase4:44069] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 13:12:43,357 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=6ef2944a6f2d1ea2d592d623cc763676, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:43,357 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=9673c9a25a64047b5e8e56c0868ad3b6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:43,357 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689599563106.6ef2944a6f2d1ea2d592d623cc763676.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689599563357"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599563357"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599563357"}]},"ts":"1689599563357"} 2023-07-17 13:12:43,357 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689599563106.9673c9a25a64047b5e8e56c0868ad3b6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689599563357"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599563357"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599563357"}]},"ts":"1689599563357"} 2023-07-17 13:12:43,359 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 6ef2944a6f2d1ea2d592d623cc763676, server=jenkins-hbase4.apache.org,45883,1689599458200}] 2023-07-17 13:12:43,360 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 9673c9a25a64047b5e8e56c0868ad3b6, server=jenkins-hbase4.apache.org,43575,1689599458131}] 2023-07-17 13:12:43,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-17 13:12:43,515 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689599563106.9673c9a25a64047b5e8e56c0868ad3b6. 2023-07-17 13:12:43,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9673c9a25a64047b5e8e56c0868ad3b6, NAME => 'testtb-testEmptyExportFileSystemState,1,1689599563106.9673c9a25a64047b5e8e56c0868ad3b6.', STARTKEY => '1', ENDKEY => ''} 2023-07-17 13:12:43,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689599563106.9673c9a25a64047b5e8e56c0868ad3b6. service=AccessControlService 2023-07-17 13:12:43,516 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 13:12:43,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 9673c9a25a64047b5e8e56c0868ad3b6 2023-07-17 13:12:43,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689599563106.9673c9a25a64047b5e8e56c0868ad3b6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:12:43,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9673c9a25a64047b5e8e56c0868ad3b6 2023-07-17 13:12:43,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9673c9a25a64047b5e8e56c0868ad3b6 2023-07-17 13:12:43,527 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689599563106.6ef2944a6f2d1ea2d592d623cc763676. 2023-07-17 13:12:43,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6ef2944a6f2d1ea2d592d623cc763676, NAME => 'testtb-testEmptyExportFileSystemState,,1689599563106.6ef2944a6f2d1ea2d592d623cc763676.', STARTKEY => '', ENDKEY => '1'} 2023-07-17 13:12:43,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689599563106.6ef2944a6f2d1ea2d592d623cc763676. service=AccessControlService 2023-07-17 13:12:43,528 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 13:12:43,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 6ef2944a6f2d1ea2d592d623cc763676 2023-07-17 13:12:43,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689599563106.6ef2944a6f2d1ea2d592d623cc763676.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:12:43,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6ef2944a6f2d1ea2d592d623cc763676 2023-07-17 13:12:43,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6ef2944a6f2d1ea2d592d623cc763676 2023-07-17 13:12:43,535 INFO [StoreOpener-9673c9a25a64047b5e8e56c0868ad3b6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9673c9a25a64047b5e8e56c0868ad3b6 2023-07-17 13:12:43,536 INFO [StoreOpener-6ef2944a6f2d1ea2d592d623cc763676-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6ef2944a6f2d1ea2d592d623cc763676 2023-07-17 13:12:43,543 DEBUG [StoreOpener-9673c9a25a64047b5e8e56c0868ad3b6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testEmptyExportFileSystemState/9673c9a25a64047b5e8e56c0868ad3b6/cf 2023-07-17 13:12:43,543 DEBUG [StoreOpener-9673c9a25a64047b5e8e56c0868ad3b6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testEmptyExportFileSystemState/9673c9a25a64047b5e8e56c0868ad3b6/cf 2023-07-17 13:12:43,543 DEBUG [StoreOpener-6ef2944a6f2d1ea2d592d623cc763676-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testEmptyExportFileSystemState/6ef2944a6f2d1ea2d592d623cc763676/cf 2023-07-17 13:12:43,543 DEBUG [StoreOpener-6ef2944a6f2d1ea2d592d623cc763676-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testEmptyExportFileSystemState/6ef2944a6f2d1ea2d592d623cc763676/cf 2023-07-17 13:12:43,544 INFO [StoreOpener-9673c9a25a64047b5e8e56c0868ad3b6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9673c9a25a64047b5e8e56c0868ad3b6 columnFamilyName cf 2023-07-17 13:12:43,545 INFO [StoreOpener-9673c9a25a64047b5e8e56c0868ad3b6-1] regionserver.HStore(310): Store=9673c9a25a64047b5e8e56c0868ad3b6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:12:43,545 INFO [StoreOpener-6ef2944a6f2d1ea2d592d623cc763676-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6ef2944a6f2d1ea2d592d623cc763676 columnFamilyName cf 2023-07-17 13:12:43,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testEmptyExportFileSystemState/9673c9a25a64047b5e8e56c0868ad3b6 2023-07-17 13:12:43,546 INFO [StoreOpener-6ef2944a6f2d1ea2d592d623cc763676-1] regionserver.HStore(310): Store=6ef2944a6f2d1ea2d592d623cc763676/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:12:43,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testEmptyExportFileSystemState/9673c9a25a64047b5e8e56c0868ad3b6 2023-07-17 13:12:43,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testEmptyExportFileSystemState/6ef2944a6f2d1ea2d592d623cc763676 2023-07-17 13:12:43,548 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testEmptyExportFileSystemState/6ef2944a6f2d1ea2d592d623cc763676 2023-07-17 13:12:43,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6ef2944a6f2d1ea2d592d623cc763676 2023-07-17 13:12:43,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9673c9a25a64047b5e8e56c0868ad3b6 2023-07-17 13:12:43,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testEmptyExportFileSystemState/6ef2944a6f2d1ea2d592d623cc763676/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 13:12:43,557 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6ef2944a6f2d1ea2d592d623cc763676; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74623571, jitterRate=0.11197786033153534}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 13:12:43,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6ef2944a6f2d1ea2d592d623cc763676: 2023-07-17 13:12:43,558 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689599563106.6ef2944a6f2d1ea2d592d623cc763676., pid=93, masterSystemTime=1689599563511 2023-07-17 13:12:43,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testEmptyExportFileSystemState/9673c9a25a64047b5e8e56c0868ad3b6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 13:12:43,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689599563106.6ef2944a6f2d1ea2d592d623cc763676. 2023-07-17 13:12:43,560 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689599563106.6ef2944a6f2d1ea2d592d623cc763676. 2023-07-17 13:12:43,560 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9673c9a25a64047b5e8e56c0868ad3b6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71846596, jitterRate=0.07059770822525024}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 13:12:43,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9673c9a25a64047b5e8e56c0868ad3b6: 2023-07-17 13:12:43,561 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689599563106.9673c9a25a64047b5e8e56c0868ad3b6., pid=94, masterSystemTime=1689599563511 2023-07-17 13:12:43,563 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=6ef2944a6f2d1ea2d592d623cc763676, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:43,563 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689599563106.6ef2944a6f2d1ea2d592d623cc763676.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689599563563"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689599563563"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689599563563"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689599563563"}]},"ts":"1689599563563"} 2023-07-17 13:12:43,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689599563106.9673c9a25a64047b5e8e56c0868ad3b6. 2023-07-17 13:12:43,564 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689599563106.9673c9a25a64047b5e8e56c0868ad3b6. 2023-07-17 13:12:43,565 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=9673c9a25a64047b5e8e56c0868ad3b6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:43,565 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689599563106.9673c9a25a64047b5e8e56c0868ad3b6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689599563565"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689599563565"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689599563565"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689599563565"}]},"ts":"1689599563565"} 2023-07-17 13:12:43,568 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-17 13:12:43,568 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 6ef2944a6f2d1ea2d592d623cc763676, server=jenkins-hbase4.apache.org,45883,1689599458200 in 206 msec 2023-07-17 13:12:43,569 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-17 13:12:43,569 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6ef2944a6f2d1ea2d592d623cc763676, ASSIGN in 368 msec 2023-07-17 13:12:43,569 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 9673c9a25a64047b5e8e56c0868ad3b6, server=jenkins-hbase4.apache.org,43575,1689599458131 in 207 msec 2023-07-17 13:12:43,572 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-17 13:12:43,572 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=9673c9a25a64047b5e8e56c0868ad3b6, ASSIGN in 369 msec 2023-07-17 13:12:43,573 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 13:12:43,573 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599563573"}]},"ts":"1689599563573"} 2023-07-17 13:12:43,575 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-17 13:12:43,578 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 13:12:43,578 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-17 13:12:43,580 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43575] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-17 13:12:43,582 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:43,582 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:43,582 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:43,582 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:43,584 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:43,584 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:43,584 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:43,584 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:43,586 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 477 msec 2023-07-17 13:12:43,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-17 13:12:43,720 INFO [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-17 13:12:43,720 DEBUG [Listener at jenkins-hbase4.apache.org/38153] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-17 13:12:43,720 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 13:12:43,742 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-17 13:12:43,742 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 13:12:43,742 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-17 13:12:43,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 13:12:43,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689599563759 (current time:1689599563759). 2023-07-17 13:12:43,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 13:12:43,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(139): Connect 0x5802adc0 to 127.0.0.1:56233 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:12:43,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41c83917, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:12:43,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:12:43,786 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40450, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:12:43,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5802adc0 to 127.0.0.1:56233 2023-07-17 13:12:43,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:12:43,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(139): Connect 0x3e846e3d to 127.0.0.1:56233 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:12:43,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73a5a880, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:12:43,798 DEBUG [hconnection-0x73252762-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:12:43,799 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40456, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:12:43,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:12:43,809 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35226, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:12:43,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3e846e3d to 127.0.0.1:56233 2023-07-17 13:12:43,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:12:43,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-17 13:12:43,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 13:12:43,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 13:12:43,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-17 13:12:43,815 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-17 13:12:43,816 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689600163816 2023-07-17 13:12:43,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 13:12:43,816 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-17 13:12:43,817 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 13:12:43,820 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 13:12:43,820 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-17 13:12:43,823 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-17 13:12:43,826 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-17 13:12:43,832 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-17 13:12:43,835 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689600163835 2023-07-17 13:12:43,882 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,883 INFO [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-17 13:12:43,883 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:43,893 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-17 13:12:43,893 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-17 13:12:43,894 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,894 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,898 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:43,898 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:43,898 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:43,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:43,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:43,898 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:43,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:43,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:43,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:43,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:43,899 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:43,899 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:43,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,900 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,900 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:43,900 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 13:12:43,900 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,900 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-17 13:12:43,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,901 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-17 13:12:43,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-17 13:12:43,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,901 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-17 13:12:43,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-17 13:12:43,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,901 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,901 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-17 13:12:43,902 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-17 13:12:43,902 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,902 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:43,902 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-17 13:12:43,902 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:43,902 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,904 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-17 13:12:43,905 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-17 13:12:43,905 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:43,904 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-17 13:12:43,906 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-17 13:12:43,906 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-17 13:12:43,906 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45883,1689599458200' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-17 13:12:43,905 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-17 13:12:43,906 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-17 13:12:43,907 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43575,1689599458131' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-17 13:12:43,907 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42601,1689599458269' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-17 13:12:43,911 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:43,911 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:43,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:43,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:43,912 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,912 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:43,912 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,912 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:12:43,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:43,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:43,913 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,913 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:12:43,913 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,914 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,914 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:12:43,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:43,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:43,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:43,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:43,916 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45883,1689599458200' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-17 13:12:43,916 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73a88635[Count = 1] remaining members to acquire global barrier 2023-07-17 13:12:43,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:43,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:43,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:43,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:43,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:43,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:43,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:43,920 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:12:43,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 13:12:43,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 13:12:43,921 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 13:12:43,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:43,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:43,923 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43575,1689599458131' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-17 13:12:43,923 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73a88635[Count = 0] remaining members to acquire global barrier 2023-07-17 13:12:43,923 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-17 13:12:43,924 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,926 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,926 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,926 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,927 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-17 13:12:43,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,927 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:12:43,927 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-17 13:12:43,927 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-17 13:12:43,927 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:43,927 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42601,1689599458269' in zk 2023-07-17 13:12:43,927 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:12:43,927 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-17 13:12:43,927 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689599563106.9673c9a25a64047b5e8e56c0868ad3b6. 2023-07-17 13:12:43,927 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:12:43,927 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:12:43,927 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689599563106.9673c9a25a64047b5e8e56c0868ad3b6. started... 2023-07-17 13:12:43,928 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689599563106.6ef2944a6f2d1ea2d592d623cc763676. 2023-07-17 13:12:43,928 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:43,930 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 13:12:43,931 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-17 13:12:43,931 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:12:43,931 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-17 13:12:43,928 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689599563106.6ef2944a6f2d1ea2d592d623cc763676. started... 2023-07-17 13:12:43,930 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9673c9a25a64047b5e8e56c0868ad3b6: 2023-07-17 13:12:43,935 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689599563106.9673c9a25a64047b5e8e56c0868ad3b6.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,935 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6ef2944a6f2d1ea2d592d623cc763676: 2023-07-17 13:12:43,935 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:12:43,936 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 13:12:43,936 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689599563106.6ef2944a6f2d1ea2d592d623cc763676.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,936 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:12:43,936 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 13:12:43,961 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689599563106.6ef2944a6f2d1ea2d592d623cc763676. completed. 2023-07-17 13:12:43,961 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689599563106.6ef2944a6f2d1ea2d592d623cc763676. 2023-07-17 13:12:43,962 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:12:43,962 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:12:43,962 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:43,962 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-17 13:12:43,962 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45883,1689599458200' in zk 2023-07-17 13:12:43,964 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:43,964 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-17 13:12:43,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:43,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:43,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:43,964 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:12:43,964 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-17 13:12:43,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:43,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:43,967 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689599563106.9673c9a25a64047b5e8e56c0868ad3b6. completed. 2023-07-17 13:12:43,967 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689599563106.9673c9a25a64047b5e8e56c0868ad3b6. 2023-07-17 13:12:43,967 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:12:43,967 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:12:43,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,967 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:43,967 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-17 13:12:43,968 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43575,1689599458131' in zk 2023-07-17 13:12:43,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:43,969 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:43,969 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-17 13:12:43,969 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:12:43,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:43,969 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-17 13:12:43,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:43,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:43,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:43,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:43,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:43,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,45883,1689599458200': 2023-07-17 13:12:43,973 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45883,1689599458200' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-17 13:12:43,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:43,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:43,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:43,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:43,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:43,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:43,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:43,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:43,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:43,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:43,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:43,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:43,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,43575,1689599458131': 2023-07-17 13:12:43,978 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43575,1689599458131' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-17 13:12:43,978 INFO [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-17 13:12:43,978 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 13:12:43,978 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 13:12:43,978 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,978 INFO [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 13:12:43,984 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,985 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:43,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,985 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:43,985 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,985 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,985 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:43,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,985 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:43,985 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:43,986 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:43,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:43,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:43,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:43,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,986 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:43,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:43,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:43,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:43,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:43,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:43,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:43,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:43,995 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:43,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:43,996 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:43,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:43,997 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:43,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:43,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:43,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:43,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:43,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:44,001 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:44,001 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:44,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:44,001 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:44,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:44,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:44,001 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,001 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:44,001 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:44,001 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:44,001 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:44,001 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState because node does not exist (not an error) 2023-07-17 13:12:44,001 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:44,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:44,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:44,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,001 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:12:44,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:44,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:44,001 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:44,004 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:44,004 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,004 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:44,004 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,004 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:44,004 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:44,004 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,004 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:44,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:44,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:44,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:44,004 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,079 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,121 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:12:44,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 13:12:44,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 13:12:44,123 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 13:12:44,141 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-17 13:12:44,141 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,141 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,141 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689599563816Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689599564001 (+185 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689599564002 (+1 ms)Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689599564016 (+14 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689599564067 (+51 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689599564141 (+74 ms) 2023-07-17 13:12:44,145 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-17 13:12:44,147 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 325 msec 2023-07-17 13:12:44,423 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:12:44,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 13:12:44,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 13:12:44,433 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45883] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689599563106.6ef2944a6f2d1ea2d592d623cc763676. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 13:12:44,438 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43575] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689599563106.9673c9a25a64047b5e8e56c0868ad3b6. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 13:12:44,442 DEBUG [Listener at jenkins-hbase4.apache.org/38153] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-17 13:12:44,442 DEBUG [Listener at jenkins-hbase4.apache.org/38153] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689599563106.6ef2944a6f2d1ea2d592d623cc763676. 2023-07-17 13:12:44,442 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 13:12:44,461 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 13:12:44,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689599564462 (current time:1689599564462). 2023-07-17 13:12:44,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 13:12:44,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(139): Connect 0x5e646890 to 127.0.0.1:56233 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:12:44,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a04a09, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:12:44,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:12:44,482 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40458, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:12:44,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5e646890 to 127.0.0.1:56233 2023-07-17 13:12:44,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:12:44,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(139): Connect 0x5a96aa6b to 127.0.0.1:56233 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:12:44,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@27cb7941, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:12:44,590 DEBUG [hconnection-0x21bd9fb3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:12:44,596 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40462, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:12:44,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:12:44,602 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35230, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:12:44,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5a96aa6b to 127.0.0.1:56233 2023-07-17 13:12:44,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:12:44,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-17 13:12:44,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 13:12:44,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 13:12:44,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-17 13:12:44,615 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-17 13:12:44,615 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689600164615 2023-07-17 13:12:44,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 13:12:44,616 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 13:12:44,616 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 13:12:44,615 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-17 13:12:44,619 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-17 13:12:44,621 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-17 13:12:44,622 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 10 msec 2023-07-17 13:12:44,623 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-17 13:12:44,624 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689600164624 2023-07-17 13:12:44,716 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:12:44,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 13:12:44,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 13:12:44,718 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 13:12:44,918 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:12:44,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 13:12:44,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 13:12:44,919 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 13:12:45,041 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,041 INFO [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-17 13:12:45,041 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:45,041 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-17 13:12:45,041 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-17 13:12:45,042 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,042 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,043 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:45,043 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:45,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:45,043 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:45,043 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:45,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:45,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:45,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:45,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:45,044 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:45,044 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:45,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:45,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,044 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:45,044 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,044 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 13:12:45,044 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,045 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-17 13:12:45,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-17 13:12:45,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,045 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-17 13:12:45,045 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-17 13:12:45,045 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,045 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-17 13:12:45,045 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,045 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:45,045 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-17 13:12:45,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-17 13:12:45,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,048 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-17 13:12:45,047 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-17 13:12:45,048 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,046 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:45,048 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-17 13:12:45,048 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-17 13:12:45,048 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42601,1689599458269' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-17 13:12:45,048 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:45,064 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-17 13:12:45,064 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-17 13:12:45,064 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-17 13:12:45,064 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-17 13:12:45,064 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43575,1689599458131' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-17 13:12:45,064 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45883,1689599458200' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-17 13:12:45,066 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,067 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,067 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,067 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:45,067 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:12:45,067 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:45,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:45,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:45,067 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:45,067 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,067 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:12:45,067 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,067 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:12:45,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:45,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:45,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:45,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:45,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:45,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:45,070 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43575,1689599458131' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-17 13:12:45,070 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e170b51[Count = 1] remaining members to acquire global barrier 2023-07-17 13:12:45,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:45,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:45,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:45,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:45,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:45,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:45,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:45,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:45,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:45,073 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45883,1689599458200' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-17 13:12:45,073 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e170b51[Count = 0] remaining members to acquire global barrier 2023-07-17 13:12:45,073 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-17 13:12:45,073 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,078 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,078 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,078 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,078 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:45,078 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-17 13:12:45,078 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-17 13:12:45,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,079 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-17 13:12:45,079 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-17 13:12:45,079 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42601,1689599458269' in zk 2023-07-17 13:12:45,079 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:45,079 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 13:12:45,079 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:12:45,079 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689599563106.6ef2944a6f2d1ea2d592d623cc763676. 2023-07-17 13:12:45,079 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:12:45,079 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689599563106.6ef2944a6f2d1ea2d592d623cc763676. started... 2023-07-17 13:12:45,079 INFO [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6ef2944a6f2d1ea2d592d623cc763676 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-17 13:12:45,081 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-17 13:12:45,081 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:12:45,081 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-17 13:12:45,085 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:12:45,085 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:12:45,085 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689599563106.9673c9a25a64047b5e8e56c0868ad3b6. 2023-07-17 13:12:45,085 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689599563106.9673c9a25a64047b5e8e56c0868ad3b6. started... 2023-07-17 13:12:45,085 INFO [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9673c9a25a64047b5e8e56c0868ad3b6 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-17 13:12:45,111 INFO [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testEmptyExportFileSystemState/6ef2944a6f2d1ea2d592d623cc763676/.tmp/cf/f834e230e03b440292876ca1ceef78f8 2023-07-17 13:12:45,117 INFO [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testEmptyExportFileSystemState/9673c9a25a64047b5e8e56c0868ad3b6/.tmp/cf/802cf00d0b0a48488d9502324b78802e 2023-07-17 13:12:45,119 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testEmptyExportFileSystemState/6ef2944a6f2d1ea2d592d623cc763676/.tmp/cf/f834e230e03b440292876ca1ceef78f8 as hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testEmptyExportFileSystemState/6ef2944a6f2d1ea2d592d623cc763676/cf/f834e230e03b440292876ca1ceef78f8 2023-07-17 13:12:45,125 INFO [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testEmptyExportFileSystemState/6ef2944a6f2d1ea2d592d623cc763676/cf/f834e230e03b440292876ca1ceef78f8, entries=2, sequenceid=6, filesize=5.0 K 2023-07-17 13:12:45,127 INFO [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 6ef2944a6f2d1ea2d592d623cc763676 in 48ms, sequenceid=6, compaction requested=false 2023-07-17 13:12:45,127 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-17 13:12:45,128 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6ef2944a6f2d1ea2d592d623cc763676: 2023-07-17 13:12:45,128 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689599563106.6ef2944a6f2d1ea2d592d623cc763676.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,128 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:12:45,128 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testEmptyExportFileSystemState/6ef2944a6f2d1ea2d592d623cc763676/cf/f834e230e03b440292876ca1ceef78f8] hfiles 2023-07-17 13:12:45,128 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testEmptyExportFileSystemState/6ef2944a6f2d1ea2d592d623cc763676/cf/f834e230e03b440292876ca1ceef78f8 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,134 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testEmptyExportFileSystemState/9673c9a25a64047b5e8e56c0868ad3b6/.tmp/cf/802cf00d0b0a48488d9502324b78802e as hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testEmptyExportFileSystemState/9673c9a25a64047b5e8e56c0868ad3b6/cf/802cf00d0b0a48488d9502324b78802e 2023-07-17 13:12:45,153 INFO [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testEmptyExportFileSystemState/9673c9a25a64047b5e8e56c0868ad3b6/cf/802cf00d0b0a48488d9502324b78802e, entries=48, sequenceid=6, filesize=8.1 K 2023-07-17 13:12:45,154 INFO [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 9673c9a25a64047b5e8e56c0868ad3b6 in 69ms, sequenceid=6, compaction requested=false 2023-07-17 13:12:45,156 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9673c9a25a64047b5e8e56c0868ad3b6: 2023-07-17 13:12:45,156 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689599563106.9673c9a25a64047b5e8e56c0868ad3b6.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,158 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:12:45,158 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testEmptyExportFileSystemState/9673c9a25a64047b5e8e56c0868ad3b6/cf/802cf00d0b0a48488d9502324b78802e] hfiles 2023-07-17 13:12:45,158 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testEmptyExportFileSystemState/9673c9a25a64047b5e8e56c0868ad3b6/cf/802cf00d0b0a48488d9502324b78802e for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,170 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689599563106.6ef2944a6f2d1ea2d592d623cc763676. completed. 2023-07-17 13:12:45,170 DEBUG [rs(jenkins-hbase4.apache.org,45883,1689599458200)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689599563106.6ef2944a6f2d1ea2d592d623cc763676. 2023-07-17 13:12:45,171 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:12:45,171 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:12:45,171 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:45,171 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-17 13:12:45,171 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45883,1689599458200' in zk 2023-07-17 13:12:45,175 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:45,175 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-17 13:12:45,175 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:12:45,175 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-17 13:12:45,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:45,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:45,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:45,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:45,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:45,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,179 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689599563106.9673c9a25a64047b5e8e56c0868ad3b6. completed. 2023-07-17 13:12:45,179 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689599563106.9673c9a25a64047b5e8e56c0868ad3b6. 2023-07-17 13:12:45,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:45,179 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:12:45,179 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:12:45,179 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:45,179 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-17 13:12:45,179 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43575,1689599458131' in zk 2023-07-17 13:12:45,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:45,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:45,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:45,181 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:45,181 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-17 13:12:45,181 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:12:45,181 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-17 13:12:45,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:45,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:45,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:45,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,45883,1689599458200': 2023-07-17 13:12:45,184 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45883,1689599458200' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-17 13:12:45,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:45,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:45,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:45,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:45,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:45,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:45,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:45,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:45,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:45,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:45,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:45,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:45,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,43575,1689599458131': 2023-07-17 13:12:45,196 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43575,1689599458131' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-17 13:12:45,196 INFO [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-17 13:12:45,196 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 13:12:45,196 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 13:12:45,196 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,196 INFO [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 13:12:45,199 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,199 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,199 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,199 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:45,199 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:45,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,199 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:45,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,199 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:45,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:45,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:45,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:45,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:45,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:45,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:45,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:45,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,200 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:45,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:45,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,201 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:45,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,201 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:45,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:45,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:45,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:45,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:45,204 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:45,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:45,205 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:45,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,207 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:45,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:45,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:45,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:45,210 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:45,210 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:45,210 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:45,210 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:12:45,210 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:45,210 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:45,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:45,210 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:45,211 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:45,210 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:45,210 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:45,213 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:45,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:45,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:45,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:45,212 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:45,213 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,213 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:45,213 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,213 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:45,213 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:45,213 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,213 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,212 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:45,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:45,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:45,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:45,214 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:45,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:45,219 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:12:45,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 13:12:45,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 13:12:45,221 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-17 13:12:45,245 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,270 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-17 13:12:45,270 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,270 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,271 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689599564616Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689599565213 (+597 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689599565213Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689599565217 (+4 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689599565238 (+21 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689599565270 (+32 ms) 2023-07-17 13:12:45,273 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-17 13:12:45,275 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 656 msec 2023-07-17 13:12:45,721 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:12:45,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 13:12:45,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 13:12:45,722 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599565722 2023-07-17 13:12:45,723 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37401, tgtDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599565722, rawTgtDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599565722, srcFsUri=hdfs://localhost:37401, srcDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b 2023-07-17 13:12:45,748 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37401, inputRoot=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b 2023-07-17 13:12:45,748 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-563294758_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599565722, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599565722/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,748 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37401, inputRoot=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b, snapshotDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-17 13:12:45,760 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599565722/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,780 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:45,780 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:45,781 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:45,781 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:46,931 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/hadoop-2332804062978510689.jar 2023-07-17 13:12:46,932 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:46,932 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:47,015 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/hadoop-3378611717374034147.jar 2023-07-17 13:12:47,016 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:47,016 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:47,016 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:47,017 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:47,017 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:47,018 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:47,018 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 13:12:47,018 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 13:12:47,019 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 13:12:47,019 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 13:12:47,020 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 13:12:47,020 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 13:12:47,021 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 13:12:47,021 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 13:12:47,021 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 13:12:47,022 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 13:12:47,023 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:12:47,023 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:12:47,024 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 13:12:47,024 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:12:47,025 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:12:47,025 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 13:12:47,026 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 13:12:47,200 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467386_0005_000001 (auth:SIMPLE) 2023-07-17 13:12:47,971 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 13:12:48,303 WARN [Listener at jenkins-hbase4.apache.org/38153] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 13:12:48,306 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-17 13:12:48,559 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 13:12:48,559 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 13:12:48,860 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467386_0006_000001 (auth:SIMPLE) 2023-07-17 13:12:55,280 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467386_0006_000001 (auth:SIMPLE) 2023-07-17 13:12:57,897 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 13:12:57,898 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 13:12:57,903 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:57,903 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 13:12:57,904 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 13:12:57,904 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-233758021_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:57,904 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(367): hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-17 13:12:57,904 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(367): hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-17 13:12:57,905 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-233758021_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599565722/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599565722/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:57,905 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(367): hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599565722/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-17 13:12:57,905 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(367): hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599565722/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-17 13:12:57,910 INFO [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-17 13:12:57,910 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-17 13:12:57,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 13:12:57,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-17 13:12:57,916 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599577916"}]},"ts":"1689599577916"} 2023-07-17 13:12:57,917 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-17 13:12:57,919 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-17 13:12:57,920 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6ef2944a6f2d1ea2d592d623cc763676, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=9673c9a25a64047b5e8e56c0868ad3b6, UNASSIGN}] 2023-07-17 13:12:57,922 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6ef2944a6f2d1ea2d592d623cc763676, UNASSIGN 2023-07-17 13:12:57,922 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=9673c9a25a64047b5e8e56c0868ad3b6, UNASSIGN 2023-07-17 13:12:57,923 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=9673c9a25a64047b5e8e56c0868ad3b6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:57,923 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=6ef2944a6f2d1ea2d592d623cc763676, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:57,923 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689599563106.9673c9a25a64047b5e8e56c0868ad3b6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689599577923"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599577923"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599577923"}]},"ts":"1689599577923"} 2023-07-17 13:12:57,923 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689599563106.6ef2944a6f2d1ea2d592d623cc763676.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689599577923"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599577923"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599577923"}]},"ts":"1689599577923"} 2023-07-17 13:12:57,925 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 6ef2944a6f2d1ea2d592d623cc763676, server=jenkins-hbase4.apache.org,45883,1689599458200}] 2023-07-17 13:12:57,926 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 9673c9a25a64047b5e8e56c0868ad3b6, server=jenkins-hbase4.apache.org,43575,1689599458131}] 2023-07-17 13:12:58,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-17 13:12:58,078 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6ef2944a6f2d1ea2d592d623cc763676 2023-07-17 13:12:58,078 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6ef2944a6f2d1ea2d592d623cc763676, disabling compactions & flushes 2023-07-17 13:12:58,078 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689599563106.6ef2944a6f2d1ea2d592d623cc763676. 2023-07-17 13:12:58,078 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689599563106.6ef2944a6f2d1ea2d592d623cc763676. 2023-07-17 13:12:58,078 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689599563106.6ef2944a6f2d1ea2d592d623cc763676. after waiting 0 ms 2023-07-17 13:12:58,078 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689599563106.6ef2944a6f2d1ea2d592d623cc763676. 2023-07-17 13:12:58,082 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9673c9a25a64047b5e8e56c0868ad3b6 2023-07-17 13:12:58,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9673c9a25a64047b5e8e56c0868ad3b6, disabling compactions & flushes 2023-07-17 13:12:58,083 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689599563106.9673c9a25a64047b5e8e56c0868ad3b6. 2023-07-17 13:12:58,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689599563106.9673c9a25a64047b5e8e56c0868ad3b6. 2023-07-17 13:12:58,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689599563106.9673c9a25a64047b5e8e56c0868ad3b6. after waiting 0 ms 2023-07-17 13:12:58,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689599563106.9673c9a25a64047b5e8e56c0868ad3b6. 2023-07-17 13:12:58,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testEmptyExportFileSystemState/6ef2944a6f2d1ea2d592d623cc763676/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 13:12:58,095 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testEmptyExportFileSystemState/9673c9a25a64047b5e8e56c0868ad3b6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 13:12:58,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:12:58,097 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689599563106.9673c9a25a64047b5e8e56c0868ad3b6. 2023-07-17 13:12:58,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:12:58,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9673c9a25a64047b5e8e56c0868ad3b6: 2023-07-17 13:12:58,097 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689599563106.6ef2944a6f2d1ea2d592d623cc763676. 2023-07-17 13:12:58,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6ef2944a6f2d1ea2d592d623cc763676: 2023-07-17 13:12:58,099 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9673c9a25a64047b5e8e56c0868ad3b6 2023-07-17 13:12:58,099 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=9673c9a25a64047b5e8e56c0868ad3b6, regionState=CLOSED 2023-07-17 13:12:58,099 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689599563106.9673c9a25a64047b5e8e56c0868ad3b6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689599578099"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599578099"}]},"ts":"1689599578099"} 2023-07-17 13:12:58,099 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6ef2944a6f2d1ea2d592d623cc763676 2023-07-17 13:12:58,100 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=6ef2944a6f2d1ea2d592d623cc763676, regionState=CLOSED 2023-07-17 13:12:58,100 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689599563106.6ef2944a6f2d1ea2d592d623cc763676.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689599578100"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599578100"}]},"ts":"1689599578100"} 2023-07-17 13:12:58,103 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-17 13:12:58,103 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 9673c9a25a64047b5e8e56c0868ad3b6, server=jenkins-hbase4.apache.org,43575,1689599458131 in 175 msec 2023-07-17 13:12:58,103 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-17 13:12:58,103 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 6ef2944a6f2d1ea2d592d623cc763676, server=jenkins-hbase4.apache.org,45883,1689599458200 in 177 msec 2023-07-17 13:12:58,104 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=9673c9a25a64047b5e8e56c0868ad3b6, UNASSIGN in 183 msec 2023-07-17 13:12:58,106 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-17 13:12:58,106 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6ef2944a6f2d1ea2d592d623cc763676, UNASSIGN in 183 msec 2023-07-17 13:12:58,106 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599578106"}]},"ts":"1689599578106"} 2023-07-17 13:12:58,108 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-17 13:12:58,109 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-17 13:12:58,111 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 199 msec 2023-07-17 13:12:58,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-17 13:12:58,218 INFO [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-17 13:12:58,219 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-17 13:12:58,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 13:12:58,223 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 13:12:58,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-17 13:12:58,224 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 13:12:58,225 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43575] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-17 13:12:58,228 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 13:12:58,228 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 13:12:58,228 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 13:12:58,228 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 13:12:58,229 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-17 13:12:58,229 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-17 13:12:58,229 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-17 13:12:58,230 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-17 13:12:58,230 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 13:12:58,230 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 13:12:58,230 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 13:12:58,230 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:58,230 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testEmptyExportFileSystemState/9673c9a25a64047b5e8e56c0868ad3b6 2023-07-17 13:12:58,230 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 13:12:58,231 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ef2944a6f2d1ea2d592d623cc763676 2023-07-17 13:12:58,230 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:58,230 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:58,231 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:58,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-17 13:12:58,234 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testEmptyExportFileSystemState/9673c9a25a64047b5e8e56c0868ad3b6/cf, FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testEmptyExportFileSystemState/9673c9a25a64047b5e8e56c0868ad3b6/recovered.edits] 2023-07-17 13:12:58,234 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ef2944a6f2d1ea2d592d623cc763676/cf, FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ef2944a6f2d1ea2d592d623cc763676/recovered.edits] 2023-07-17 13:12:58,239 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testEmptyExportFileSystemState/9673c9a25a64047b5e8e56c0868ad3b6/cf/802cf00d0b0a48488d9502324b78802e to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/archive/data/default/testtb-testEmptyExportFileSystemState/9673c9a25a64047b5e8e56c0868ad3b6/cf/802cf00d0b0a48488d9502324b78802e 2023-07-17 13:12:58,239 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ef2944a6f2d1ea2d592d623cc763676/cf/f834e230e03b440292876ca1ceef78f8 to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/archive/data/default/testtb-testEmptyExportFileSystemState/6ef2944a6f2d1ea2d592d623cc763676/cf/f834e230e03b440292876ca1ceef78f8 2023-07-17 13:12:58,243 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testEmptyExportFileSystemState/9673c9a25a64047b5e8e56c0868ad3b6/recovered.edits/9.seqid to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/archive/data/default/testtb-testEmptyExportFileSystemState/9673c9a25a64047b5e8e56c0868ad3b6/recovered.edits/9.seqid 2023-07-17 13:12:58,243 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ef2944a6f2d1ea2d592d623cc763676/recovered.edits/9.seqid to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/archive/data/default/testtb-testEmptyExportFileSystemState/6ef2944a6f2d1ea2d592d623cc763676/recovered.edits/9.seqid 2023-07-17 13:12:58,243 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testEmptyExportFileSystemState/9673c9a25a64047b5e8e56c0868ad3b6 2023-07-17 13:12:58,244 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testEmptyExportFileSystemState/6ef2944a6f2d1ea2d592d623cc763676 2023-07-17 13:12:58,244 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-17 13:12:58,246 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 13:12:58,249 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-17 13:12:58,251 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-17 13:12:58,252 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 13:12:58,252 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-17 13:12:58,252 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689599563106.6ef2944a6f2d1ea2d592d623cc763676.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689599578252"}]},"ts":"9223372036854775807"} 2023-07-17 13:12:58,252 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689599563106.9673c9a25a64047b5e8e56c0868ad3b6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689599578252"}]},"ts":"9223372036854775807"} 2023-07-17 13:12:58,254 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-17 13:12:58,254 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6ef2944a6f2d1ea2d592d623cc763676, NAME => 'testtb-testEmptyExportFileSystemState,,1689599563106.6ef2944a6f2d1ea2d592d623cc763676.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 9673c9a25a64047b5e8e56c0868ad3b6, NAME => 'testtb-testEmptyExportFileSystemState,1,1689599563106.9673c9a25a64047b5e8e56c0868ad3b6.', STARTKEY => '1', ENDKEY => ''}] 2023-07-17 13:12:58,254 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-17 13:12:58,255 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689599578254"}]},"ts":"9223372036854775807"} 2023-07-17 13:12:58,256 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-17 13:12:58,260 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 13:12:58,262 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 41 msec 2023-07-17 13:12:58,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-17 13:12:58,333 INFO [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-17 13:12:58,340 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-17 13:12:58,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:58,343 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-17 13:12:58,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:58,371 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=765 (was 765), OpenFileDescriptor=921 (was 917) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=705 (was 565) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 183), AvailableMemoryMB=1528 (was 2334) 2023-07-17 13:12:58,371 WARN [Listener at jenkins-hbase4.apache.org/38153] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-17 13:12:58,401 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765, OpenFileDescriptor=921, MaxFileDescriptor=60000, SystemLoadAverage=705, ProcessCount=183, AvailableMemoryMB=1525 2023-07-17 13:12:58,401 WARN [Listener at jenkins-hbase4.apache.org/38153] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-17 13:12:58,403 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-17 13:12:58,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:58,407 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 13:12:58,407 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-17 13:12:58,408 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 13:12:58,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-17 13:12:58,411 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/13cec0c5711eee3f91574c76e3b40468 2023-07-17 13:12:58,411 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/04118754c4bfa2087d3d1fb7c3bd84f1 2023-07-17 13:12:58,412 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/13cec0c5711eee3f91574c76e3b40468 empty. 2023-07-17 13:12:58,412 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/04118754c4bfa2087d3d1fb7c3bd84f1 empty. 2023-07-17 13:12:58,412 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/13cec0c5711eee3f91574c76e3b40468 2023-07-17 13:12:58,412 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/04118754c4bfa2087d3d1fb7c3bd84f1 2023-07-17 13:12:58,413 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-17 13:12:58,458 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-17 13:12:58,460 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 04118754c4bfa2087d3d1fb7c3bd84f1, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689599578402.04118754c4bfa2087d3d1fb7c3bd84f1.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp 2023-07-17 13:12:58,460 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 13cec0c5711eee3f91574c76e3b40468, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689599578402.13cec0c5711eee3f91574c76e3b40468.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp 2023-07-17 13:12:58,499 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689599578402.13cec0c5711eee3f91574c76e3b40468.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:12:58,499 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 13cec0c5711eee3f91574c76e3b40468, disabling compactions & flushes 2023-07-17 13:12:58,499 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689599578402.13cec0c5711eee3f91574c76e3b40468. 2023-07-17 13:12:58,499 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689599578402.13cec0c5711eee3f91574c76e3b40468. 2023-07-17 13:12:58,499 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689599578402.13cec0c5711eee3f91574c76e3b40468. after waiting 0 ms 2023-07-17 13:12:58,499 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689599578402.13cec0c5711eee3f91574c76e3b40468. 2023-07-17 13:12:58,499 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689599578402.13cec0c5711eee3f91574c76e3b40468. 2023-07-17 13:12:58,499 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 13cec0c5711eee3f91574c76e3b40468: 2023-07-17 13:12:58,506 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689599578402.04118754c4bfa2087d3d1fb7c3bd84f1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:12:58,506 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 04118754c4bfa2087d3d1fb7c3bd84f1, disabling compactions & flushes 2023-07-17 13:12:58,506 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689599578402.04118754c4bfa2087d3d1fb7c3bd84f1. 2023-07-17 13:12:58,506 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689599578402.04118754c4bfa2087d3d1fb7c3bd84f1. 2023-07-17 13:12:58,506 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689599578402.04118754c4bfa2087d3d1fb7c3bd84f1. after waiting 0 ms 2023-07-17 13:12:58,506 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689599578402.04118754c4bfa2087d3d1fb7c3bd84f1. 2023-07-17 13:12:58,506 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689599578402.04118754c4bfa2087d3d1fb7c3bd84f1. 2023-07-17 13:12:58,506 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 04118754c4bfa2087d3d1fb7c3bd84f1: 2023-07-17 13:12:58,509 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 13:12:58,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-17 13:12:58,510 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689599578402.13cec0c5711eee3f91574c76e3b40468.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689599578510"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599578510"}]},"ts":"1689599578510"} 2023-07-17 13:12:58,510 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689599578402.04118754c4bfa2087d3d1fb7c3bd84f1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689599578510"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599578510"}]},"ts":"1689599578510"} 2023-07-17 13:12:58,512 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 13:12:58,513 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 13:12:58,513 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599578513"}]},"ts":"1689599578513"} 2023-07-17 13:12:58,514 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-17 13:12:58,517 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 13:12:58,518 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 13:12:58,518 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 13:12:58,518 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 13:12:58,518 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 13:12:58,518 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=13cec0c5711eee3f91574c76e3b40468, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=04118754c4bfa2087d3d1fb7c3bd84f1, ASSIGN}] 2023-07-17 13:12:58,523 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=13cec0c5711eee3f91574c76e3b40468, ASSIGN 2023-07-17 13:12:58,523 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=04118754c4bfa2087d3d1fb7c3bd84f1, ASSIGN 2023-07-17 13:12:58,524 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=04118754c4bfa2087d3d1fb7c3bd84f1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43575,1689599458131; forceNewPlan=false, retain=false 2023-07-17 13:12:58,524 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=13cec0c5711eee3f91574c76e3b40468, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42601,1689599458269; forceNewPlan=false, retain=false 2023-07-17 13:12:58,674 INFO [jenkins-hbase4:44069] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 13:12:58,679 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=04118754c4bfa2087d3d1fb7c3bd84f1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:58,679 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=13cec0c5711eee3f91574c76e3b40468, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:58,679 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689599578402.04118754c4bfa2087d3d1fb7c3bd84f1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689599578679"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599578679"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599578679"}]},"ts":"1689599578679"} 2023-07-17 13:12:58,679 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689599578402.13cec0c5711eee3f91574c76e3b40468.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689599578679"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599578679"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599578679"}]},"ts":"1689599578679"} 2023-07-17 13:12:58,684 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 04118754c4bfa2087d3d1fb7c3bd84f1, server=jenkins-hbase4.apache.org,43575,1689599458131}] 2023-07-17 13:12:58,686 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 13cec0c5711eee3f91574c76e3b40468, server=jenkins-hbase4.apache.org,42601,1689599458269}] 2023-07-17 13:12:58,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-17 13:12:58,843 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689599578402.04118754c4bfa2087d3d1fb7c3bd84f1. 2023-07-17 13:12:58,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 04118754c4bfa2087d3d1fb7c3bd84f1, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689599578402.04118754c4bfa2087d3d1fb7c3bd84f1.', STARTKEY => '1', ENDKEY => ''} 2023-07-17 13:12:58,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689599578402.04118754c4bfa2087d3d1fb7c3bd84f1. service=AccessControlService 2023-07-17 13:12:58,844 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 13:12:58,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 04118754c4bfa2087d3d1fb7c3bd84f1 2023-07-17 13:12:58,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689599578402.04118754c4bfa2087d3d1fb7c3bd84f1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:12:58,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 04118754c4bfa2087d3d1fb7c3bd84f1 2023-07-17 13:12:58,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 04118754c4bfa2087d3d1fb7c3bd84f1 2023-07-17 13:12:58,847 INFO [StoreOpener-04118754c4bfa2087d3d1fb7c3bd84f1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 04118754c4bfa2087d3d1fb7c3bd84f1 2023-07-17 13:12:58,849 DEBUG [StoreOpener-04118754c4bfa2087d3d1fb7c3bd84f1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithSkipTmp/04118754c4bfa2087d3d1fb7c3bd84f1/cf 2023-07-17 13:12:58,849 DEBUG [StoreOpener-04118754c4bfa2087d3d1fb7c3bd84f1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithSkipTmp/04118754c4bfa2087d3d1fb7c3bd84f1/cf 2023-07-17 13:12:58,849 INFO [StoreOpener-04118754c4bfa2087d3d1fb7c3bd84f1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 04118754c4bfa2087d3d1fb7c3bd84f1 columnFamilyName cf 2023-07-17 13:12:58,850 INFO [StoreOpener-04118754c4bfa2087d3d1fb7c3bd84f1-1] regionserver.HStore(310): Store=04118754c4bfa2087d3d1fb7c3bd84f1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:12:58,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithSkipTmp/04118754c4bfa2087d3d1fb7c3bd84f1 2023-07-17 13:12:58,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithSkipTmp/04118754c4bfa2087d3d1fb7c3bd84f1 2023-07-17 13:12:58,853 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689599578402.13cec0c5711eee3f91574c76e3b40468. 2023-07-17 13:12:58,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 13cec0c5711eee3f91574c76e3b40468, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689599578402.13cec0c5711eee3f91574c76e3b40468.', STARTKEY => '', ENDKEY => '1'} 2023-07-17 13:12:58,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689599578402.13cec0c5711eee3f91574c76e3b40468. service=AccessControlService 2023-07-17 13:12:58,854 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 13:12:58,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 13cec0c5711eee3f91574c76e3b40468 2023-07-17 13:12:58,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689599578402.13cec0c5711eee3f91574c76e3b40468.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:12:58,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 13cec0c5711eee3f91574c76e3b40468 2023-07-17 13:12:58,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 13cec0c5711eee3f91574c76e3b40468 2023-07-17 13:12:58,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 04118754c4bfa2087d3d1fb7c3bd84f1 2023-07-17 13:12:58,859 INFO [StoreOpener-13cec0c5711eee3f91574c76e3b40468-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 13cec0c5711eee3f91574c76e3b40468 2023-07-17 13:12:58,861 DEBUG [StoreOpener-13cec0c5711eee3f91574c76e3b40468-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithSkipTmp/13cec0c5711eee3f91574c76e3b40468/cf 2023-07-17 13:12:58,861 DEBUG [StoreOpener-13cec0c5711eee3f91574c76e3b40468-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithSkipTmp/13cec0c5711eee3f91574c76e3b40468/cf 2023-07-17 13:12:58,862 INFO [StoreOpener-13cec0c5711eee3f91574c76e3b40468-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 13cec0c5711eee3f91574c76e3b40468 columnFamilyName cf 2023-07-17 13:12:58,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithSkipTmp/04118754c4bfa2087d3d1fb7c3bd84f1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 13:12:58,863 INFO [StoreOpener-13cec0c5711eee3f91574c76e3b40468-1] regionserver.HStore(310): Store=13cec0c5711eee3f91574c76e3b40468/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:12:58,863 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 04118754c4bfa2087d3d1fb7c3bd84f1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59649743, jitterRate=-0.11114956438541412}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 13:12:58,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 04118754c4bfa2087d3d1fb7c3bd84f1: 2023-07-17 13:12:58,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithSkipTmp/13cec0c5711eee3f91574c76e3b40468 2023-07-17 13:12:58,864 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689599578402.04118754c4bfa2087d3d1fb7c3bd84f1., pid=108, masterSystemTime=1689599578837 2023-07-17 13:12:58,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithSkipTmp/13cec0c5711eee3f91574c76e3b40468 2023-07-17 13:12:58,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689599578402.04118754c4bfa2087d3d1fb7c3bd84f1. 2023-07-17 13:12:58,867 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689599578402.04118754c4bfa2087d3d1fb7c3bd84f1. 2023-07-17 13:12:58,869 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=04118754c4bfa2087d3d1fb7c3bd84f1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:58,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 13cec0c5711eee3f91574c76e3b40468 2023-07-17 13:12:58,869 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689599578402.04118754c4bfa2087d3d1fb7c3bd84f1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689599578869"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689599578869"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689599578869"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689599578869"}]},"ts":"1689599578869"} 2023-07-17 13:12:58,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithSkipTmp/13cec0c5711eee3f91574c76e3b40468/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 13:12:58,873 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 13cec0c5711eee3f91574c76e3b40468; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73706990, jitterRate=0.09831973910331726}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 13:12:58,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 13cec0c5711eee3f91574c76e3b40468: 2023-07-17 13:12:58,874 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689599578402.13cec0c5711eee3f91574c76e3b40468., pid=109, masterSystemTime=1689599578839 2023-07-17 13:12:58,875 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-17 13:12:58,875 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 04118754c4bfa2087d3d1fb7c3bd84f1, server=jenkins-hbase4.apache.org,43575,1689599458131 in 188 msec 2023-07-17 13:12:58,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689599578402.13cec0c5711eee3f91574c76e3b40468. 2023-07-17 13:12:58,877 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689599578402.13cec0c5711eee3f91574c76e3b40468. 2023-07-17 13:12:58,877 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=13cec0c5711eee3f91574c76e3b40468, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:58,877 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689599578402.13cec0c5711eee3f91574c76e3b40468.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689599578877"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689599578877"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689599578877"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689599578877"}]},"ts":"1689599578877"} 2023-07-17 13:12:58,879 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=04118754c4bfa2087d3d1fb7c3bd84f1, ASSIGN in 358 msec 2023-07-17 13:12:58,881 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-17 13:12:58,881 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 13cec0c5711eee3f91574c76e3b40468, server=jenkins-hbase4.apache.org,42601,1689599458269 in 193 msec 2023-07-17 13:12:58,884 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-17 13:12:58,884 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=13cec0c5711eee3f91574c76e3b40468, ASSIGN in 364 msec 2023-07-17 13:12:58,885 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 13:12:58,885 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599578885"}]},"ts":"1689599578885"} 2023-07-17 13:12:58,886 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-17 13:12:58,889 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 13:12:58,889 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-17 13:12:58,891 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43575] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-17 13:12:58,893 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:58,893 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:58,893 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:58,893 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:58,894 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:58,894 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:58,895 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:58,895 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:58,901 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 492 msec 2023-07-17 13:12:59,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-17 13:12:59,012 INFO [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-17 13:12:59,012 DEBUG [Listener at jenkins-hbase4.apache.org/38153] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-17 13:12:59,012 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 13:12:59,015 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-17 13:12:59,015 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 13:12:59,015 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-17 13:12:59,018 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-17 13:12:59,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689599579018 (current time:1689599579018). 2023-07-17 13:12:59,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 13:12:59,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(139): Connect 0x700204b4 to 127.0.0.1:56233 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:12:59,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a04cac3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:12:59,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:12:59,037 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57744, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:12:59,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x700204b4 to 127.0.0.1:56233 2023-07-17 13:12:59,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:12:59,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(139): Connect 0x1138cd5c to 127.0.0.1:56233 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:12:59,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@71ff5c6b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:12:59,046 DEBUG [hconnection-0x7d21d245-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:12:59,054 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57754, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:12:59,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:12:59,061 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50366, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:12:59,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1138cd5c to 127.0.0.1:56233 2023-07-17 13:12:59,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:12:59,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-17 13:12:59,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 13:12:59,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-17 13:12:59,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-17 13:12:59,068 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-17 13:12:59,068 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689600179068 2023-07-17 13:12:59,068 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-17 13:12:59,070 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 13:12:59,070 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 13:12:59,071 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-17 13:12:59,072 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-17 13:12:59,072 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-07-17 13:12:59,073 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-17 13:12:59,074 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689600179074 2023-07-17 13:12:59,085 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,086 INFO [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-17 13:12:59,086 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:59,087 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-17 13:12:59,087 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-17 13:12:59,088 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,088 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,090 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:59,090 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:59,090 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:59,090 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:59,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:59,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:59,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:59,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:59,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:59,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:59,091 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:59,091 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:59,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,091 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:59,092 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 13:12:59,092 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,092 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-17 13:12:59,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-17 13:12:59,092 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-17 13:12:59,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,093 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-17 13:12:59,093 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,093 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-17 13:12:59,093 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:59,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,094 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,097 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-17 13:12:59,097 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-17 13:12:59,097 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-17 13:12:59,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,097 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-17 13:12:59,097 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43575,1689599458131' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-17 13:12:59,097 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:59,097 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-17 13:12:59,098 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,098 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-17 13:12:59,098 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:59,100 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-17 13:12:59,100 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-17 13:12:59,100 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-17 13:12:59,100 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45883,1689599458200' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-17 13:12:59,100 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-17 13:12:59,100 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42601,1689599458269' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-17 13:12:59,104 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:59,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:59,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:59,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:59,104 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,105 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,106 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:59,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:59,106 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,106 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,106 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:12:59,106 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,106 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:12:59,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:59,106 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,107 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:12:59,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:59,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:59,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:59,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:59,109 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43575,1689599458131' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-17 13:12:59,109 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f50aa47[Count = 1] remaining members to acquire global barrier 2023-07-17 13:12:59,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:59,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:59,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:59,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:59,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:59,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:59,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:59,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:59,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:59,112 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42601,1689599458269' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-17 13:12:59,112 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f50aa47[Count = 0] remaining members to acquire global barrier 2023-07-17 13:12:59,112 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-17 13:12:59,112 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,114 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,114 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,114 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,114 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-17 13:12:59,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,114 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-17 13:12:59,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,114 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:59,114 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-17 13:12:59,114 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-17 13:12:59,114 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45883,1689599458200' in zk 2023-07-17 13:12:59,115 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:12:59,115 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:12:59,115 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689599578402.04118754c4bfa2087d3d1fb7c3bd84f1. 2023-07-17 13:12:59,115 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:59,115 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 13:12:59,115 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:12:59,115 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:12:59,115 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689599578402.13cec0c5711eee3f91574c76e3b40468. 2023-07-17 13:12:59,115 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689599578402.04118754c4bfa2087d3d1fb7c3bd84f1. started... 2023-07-17 13:12:59,115 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689599578402.13cec0c5711eee3f91574c76e3b40468. started... 2023-07-17 13:12:59,117 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 04118754c4bfa2087d3d1fb7c3bd84f1: 2023-07-17 13:12:59,117 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-17 13:12:59,117 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:12:59,117 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689599578402.04118754c4bfa2087d3d1fb7c3bd84f1.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,117 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-17 13:12:59,119 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:12:59,119 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 13:12:59,119 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 13cec0c5711eee3f91574c76e3b40468: 2023-07-17 13:12:59,119 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689599578402.13cec0c5711eee3f91574c76e3b40468.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,119 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:12:59,119 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 13:12:59,139 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689599578402.04118754c4bfa2087d3d1fb7c3bd84f1. completed. 2023-07-17 13:12:59,139 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689599578402.04118754c4bfa2087d3d1fb7c3bd84f1. 2023-07-17 13:12:59,139 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:12:59,139 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:12:59,139 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:59,140 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-17 13:12:59,140 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43575,1689599458131' in zk 2023-07-17 13:12:59,143 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-17 13:12:59,143 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:59,143 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:12:59,144 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-17 13:12:59,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:59,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:59,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:59,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:59,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:59,146 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689599578402.13cec0c5711eee3f91574c76e3b40468. completed. 2023-07-17 13:12:59,146 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689599578402.13cec0c5711eee3f91574c76e3b40468. 2023-07-17 13:12:59,146 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:12:59,147 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:12:59,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,147 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:59,147 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-17 13:12:59,147 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42601,1689599458269' in zk 2023-07-17 13:12:59,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:59,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:59,149 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-17 13:12:59,149 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:59,149 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:12:59,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:59,150 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-17 13:12:59,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:59,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:59,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:59,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:59,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,43575,1689599458131': 2023-07-17 13:12:59,154 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43575,1689599458131' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-17 13:12:59,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:59,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:59,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:59,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:59,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:59,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:59,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:59,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:59,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:59,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:59,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:59,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:59,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,42601,1689599458269': 2023-07-17 13:12:59,159 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42601,1689599458269' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-17 13:12:59,159 INFO [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-17 13:12:59,159 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 13:12:59,159 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 13:12:59,159 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,159 INFO [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 13:12:59,166 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,166 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:59,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:59,166 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:59,166 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,166 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,167 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:59,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,167 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:59,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:59,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:59,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:59,167 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:59,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:59,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:59,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:59,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:59,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,169 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:59,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:59,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,170 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:59,170 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:12:59,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:59,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:59,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-17 13:12:59,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-17 13:12:59,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:59,172 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 13:12:59,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:59,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,173 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:59,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:59,174 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:59,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:59,174 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:59,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:59,179 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:59,179 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:59,179 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:59,179 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:59,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:59,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:59,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:59,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:59,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:59,179 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:59,179 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:59,180 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,180 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:59,180 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:59,180 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:59,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:59,179 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:59,180 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:12:59,180 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,180 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:59,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:59,180 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:59,182 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,182 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:59,182 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:59,182 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,182 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:59,183 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:59,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:59,229 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,372 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:12:59,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-17 13:12:59,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-17 13:12:59,373 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 13:12:59,673 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:12:59,674 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-17 13:12:59,674 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-17 13:12:59,674 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 13:12:59,674 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689599579068Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689599579180 (+112 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689599579180Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689599579185 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689599579223 (+38 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689599579674 (+451 ms) 2023-07-17 13:12:59,677 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-17 13:12:59,679 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 607 msec 2023-07-17 13:12:59,683 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689599578402.13cec0c5711eee3f91574c76e3b40468. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 13:12:59,684 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43575] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689599578402.04118754c4bfa2087d3d1fb7c3bd84f1. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 13:12:59,688 DEBUG [Listener at jenkins-hbase4.apache.org/38153] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,689 DEBUG [Listener at jenkins-hbase4.apache.org/38153] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689599578402.13cec0c5711eee3f91574c76e3b40468. 2023-07-17 13:12:59,689 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 13:12:59,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-17 13:12:59,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689599579710 (current time:1689599579710). 2023-07-17 13:12:59,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 13:12:59,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(139): Connect 0x3e9f31d1 to 127.0.0.1:56233 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:12:59,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ddf7fbd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:12:59,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:12:59,725 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57756, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:12:59,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3e9f31d1 to 127.0.0.1:56233 2023-07-17 13:12:59,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:12:59,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(139): Connect 0x31bf9162 to 127.0.0.1:56233 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:12:59,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76692f3d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:12:59,743 DEBUG [hconnection-0x407d94da-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:12:59,744 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57766, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:12:59,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:12:59,754 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50376, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:12:59,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x31bf9162 to 127.0.0.1:56233 2023-07-17 13:12:59,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:12:59,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-17 13:12:59,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 13:12:59,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-17 13:12:59,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-17 13:12:59,761 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-17 13:12:59,762 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689600179762 2023-07-17 13:12:59,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-17 13:12:59,762 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,764 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 13:12:59,764 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 13:12:59,782 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-17 13:12:59,789 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-17 13:12:59,791 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 23 msec 2023-07-17 13:12:59,792 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-17 13:12:59,793 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689600179793 2023-07-17 13:12:59,812 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,812 INFO [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-17 13:12:59,812 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:59,814 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-17 13:12:59,814 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-17 13:12:59,814 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,814 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,816 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:59,816 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:59,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:59,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:59,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:59,816 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:59,816 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:59,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:59,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:59,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:59,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,816 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:59,816 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:59,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,817 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,817 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,817 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:59,817 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 13:12:59,817 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-17 13:12:59,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,817 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-17 13:12:59,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-17 13:12:59,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-17 13:12:59,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,817 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,818 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-17 13:12:59,818 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-17 13:12:59,818 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:59,818 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-17 13:12:59,818 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,818 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-17 13:12:59,818 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,818 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:59,818 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-17 13:12:59,818 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:59,828 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-17 13:12:59,828 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-17 13:12:59,828 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-17 13:12:59,828 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-17 13:12:59,828 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-17 13:12:59,828 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45883,1689599458200' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-17 13:12:59,828 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42601,1689599458269' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-17 13:12:59,829 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-17 13:12:59,829 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43575,1689599458131' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-17 13:12:59,832 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,832 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,832 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:59,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:59,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:59,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:59,833 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,833 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,833 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:59,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:59,833 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:12:59,833 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,834 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:12:59,834 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,834 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:12:59,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:59,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:59,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:59,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:59,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:59,836 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42601,1689599458269' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-17 13:12:59,836 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c28fd6a[Count = 1] remaining members to acquire global barrier 2023-07-17 13:12:59,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:59,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:59,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:59,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:59,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:59,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:59,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:59,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:59,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:59,839 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43575,1689599458131' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-17 13:12:59,839 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c28fd6a[Count = 0] remaining members to acquire global barrier 2023-07-17 13:12:59,839 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-17 13:12:59,839 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,844 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,844 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,844 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,844 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-17 13:12:59,844 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:59,844 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-17 13:12:59,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,844 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:12:59,845 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:12:59,844 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-17 13:12:59,845 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:59,845 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45883,1689599458200' in zk 2023-07-17 13:12:59,845 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 13:12:59,845 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689599578402.04118754c4bfa2087d3d1fb7c3bd84f1. 2023-07-17 13:12:59,844 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-17 13:12:59,845 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689599578402.04118754c4bfa2087d3d1fb7c3bd84f1. started... 2023-07-17 13:12:59,845 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:12:59,845 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:12:59,845 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689599578402.13cec0c5711eee3f91574c76e3b40468. 2023-07-17 13:12:59,845 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689599578402.13cec0c5711eee3f91574c76e3b40468. started... 2023-07-17 13:12:59,845 INFO [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 04118754c4bfa2087d3d1fb7c3bd84f1 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-17 13:12:59,845 INFO [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 13cec0c5711eee3f91574c76e3b40468 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-17 13:12:59,846 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-17 13:12:59,846 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:12:59,846 DEBUG [member: 'jenkins-hbase4.apache.org,45883,1689599458200' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-17 13:12:59,864 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:12:59,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-17 13:12:59,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-17 13:12:59,865 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 13:12:59,899 INFO [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithSkipTmp/13cec0c5711eee3f91574c76e3b40468/.tmp/cf/eed989c7384846f385b810927071d0bc 2023-07-17 13:12:59,905 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithSkipTmp/13cec0c5711eee3f91574c76e3b40468/.tmp/cf/eed989c7384846f385b810927071d0bc as hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithSkipTmp/13cec0c5711eee3f91574c76e3b40468/cf/eed989c7384846f385b810927071d0bc 2023-07-17 13:12:59,910 INFO [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithSkipTmp/13cec0c5711eee3f91574c76e3b40468/cf/eed989c7384846f385b810927071d0bc, entries=5, sequenceid=6, filesize=5.2 K 2023-07-17 13:12:59,911 INFO [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 13cec0c5711eee3f91574c76e3b40468 in 66ms, sequenceid=6, compaction requested=false 2023-07-17 13:12:59,911 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-17 13:12:59,912 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 13cec0c5711eee3f91574c76e3b40468: 2023-07-17 13:12:59,912 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689599578402.13cec0c5711eee3f91574c76e3b40468.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,912 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:12:59,912 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithSkipTmp/13cec0c5711eee3f91574c76e3b40468/cf/eed989c7384846f385b810927071d0bc] hfiles 2023-07-17 13:12:59,912 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithSkipTmp/13cec0c5711eee3f91574c76e3b40468/cf/eed989c7384846f385b810927071d0bc for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,923 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689599578402.13cec0c5711eee3f91574c76e3b40468. completed. 2023-07-17 13:12:59,923 DEBUG [rs(jenkins-hbase4.apache.org,42601,1689599458269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689599578402.13cec0c5711eee3f91574c76e3b40468. 2023-07-17 13:12:59,923 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:12:59,923 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:12:59,923 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:59,923 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-17 13:12:59,923 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42601,1689599458269' in zk 2023-07-17 13:12:59,925 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:59,925 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-17 13:12:59,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:59,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:59,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:59,925 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:12:59,925 DEBUG [member: 'jenkins-hbase4.apache.org,42601,1689599458269' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-17 13:12:59,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:59,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:59,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:59,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:59,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:12:59,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:59,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:59,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:12:59,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:12:59,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,42601,1689599458269': 2023-07-17 13:12:59,932 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42601,1689599458269' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-17 13:13:00,065 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:13:00,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-17 13:13:00,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-17 13:13:00,067 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 13:13:00,294 INFO [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithSkipTmp/04118754c4bfa2087d3d1fb7c3bd84f1/.tmp/cf/fb0ca69948694bbaa870c4f5ce8bae5f 2023-07-17 13:13:00,300 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithSkipTmp/04118754c4bfa2087d3d1fb7c3bd84f1/.tmp/cf/fb0ca69948694bbaa870c4f5ce8bae5f as hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithSkipTmp/04118754c4bfa2087d3d1fb7c3bd84f1/cf/fb0ca69948694bbaa870c4f5ce8bae5f 2023-07-17 13:13:00,306 INFO [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithSkipTmp/04118754c4bfa2087d3d1fb7c3bd84f1/cf/fb0ca69948694bbaa870c4f5ce8bae5f, entries=45, sequenceid=6, filesize=7.9 K 2023-07-17 13:13:00,308 INFO [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 04118754c4bfa2087d3d1fb7c3bd84f1 in 463ms, sequenceid=6, compaction requested=false 2023-07-17 13:13:00,310 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 04118754c4bfa2087d3d1fb7c3bd84f1: 2023-07-17 13:13:00,310 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689599578402.04118754c4bfa2087d3d1fb7c3bd84f1.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,310 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:13:00,310 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithSkipTmp/04118754c4bfa2087d3d1fb7c3bd84f1/cf/fb0ca69948694bbaa870c4f5ce8bae5f] hfiles 2023-07-17 13:13:00,310 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithSkipTmp/04118754c4bfa2087d3d1fb7c3bd84f1/cf/fb0ca69948694bbaa870c4f5ce8bae5f for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,330 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689599578402.04118754c4bfa2087d3d1fb7c3bd84f1. completed. 2023-07-17 13:13:00,330 DEBUG [rs(jenkins-hbase4.apache.org,43575,1689599458131)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689599578402.04118754c4bfa2087d3d1fb7c3bd84f1. 2023-07-17 13:13:00,330 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:13:00,330 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:13:00,330 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:13:00,330 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-17 13:13:00,330 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43575,1689599458131' in zk 2023-07-17 13:13:00,333 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:13:00,333 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-17 13:13:00,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:13:00,334 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:13:00,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:13:00,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:13:00,334 DEBUG [member: 'jenkins-hbase4.apache.org,43575,1689599458131' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-17 13:13:00,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:13:00,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:13:00,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:13:00,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:13:00,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:13:00,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:13:00,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:13:00,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:13:00,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:13:00,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,43575,1689599458131': 2023-07-17 13:13:00,340 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43575,1689599458131' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-17 13:13:00,340 INFO [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-17 13:13:00,340 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 13:13:00,340 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 13:13:00,340 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,340 INFO [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 13:13:00,342 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,342 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:13:00,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:13:00,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,342 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:13:00,342 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,342 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,342 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:13:00,342 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:13:00,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:13:00,342 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:13:00,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:13:00,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:13:00,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,343 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:13:00,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:13:00,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:13:00,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:13:00,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:13:00,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:13:00,343 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:13:00,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:13:00,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:13:00,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:13:00,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:13:00,345 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:13:00,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,346 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:13:00,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:13:00,346 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:13:00,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:13:00,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:13:00,350 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:13:00,350 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:13:00,350 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:13:00,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:13:00,350 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:13:00,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:13:00,350 DEBUG [(jenkins-hbase4.apache.org,44069,1689599456641)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:13:00,350 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:13:00,350 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:13:00,350 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,350 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:13:00,350 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:13:00,352 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:13:00,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:13:00,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:13:00,352 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:13:00,353 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:13:00,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:13:00,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:13:00,353 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,353 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:13:00,353 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:13:00,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:13:00,353 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:13:00,353 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:13:00,353 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,353 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:13:00,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:13:00,354 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,367 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:13:00,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-17 13:13:00,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-17 13:13:00,369 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-17 13:13:00,388 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,410 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-17 13:13:00,410 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,410 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,410 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689599579762Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689599580352 (+590 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689599580352Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689599580361 (+9 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689599580371 (+10 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689599580410 (+39 ms) 2023-07-17 13:13:00,414 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-17 13:13:00,417 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 651 msec 2023-07-17 13:13:00,869 DEBUG [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:13:00,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-17 13:13:00,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 13:13:00,870 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599580870 2023-07-17 13:13:00,871 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37401, tgtDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599580870, rawTgtDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599580870, srcFsUri=hdfs://localhost:37401, srcDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b 2023-07-17 13:13:00,896 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37401, inputRoot=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b 2023-07-17 13:13:00,896 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-775498266_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599580870, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599580870/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,896 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37401, inputRoot=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b, snapshotDir=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-17 13:13:00,911 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599580870/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,939 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 13:13:00,940 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 13:13:00,940 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 13:13:00,941 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 13:13:02,037 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/hadoop-7072570255331758571.jar 2023-07-17 13:13:02,037 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 13:13:02,038 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 13:13:02,114 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/hadoop-6351628814835706107.jar 2023-07-17 13:13:02,114 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 13:13:02,115 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 13:13:02,115 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 13:13:02,116 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 13:13:02,116 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 13:13:02,116 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 13:13:02,117 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 13:13:02,117 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 13:13:02,117 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 13:13:02,118 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 13:13:02,118 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 13:13:02,119 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 13:13:02,119 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 13:13:02,119 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 13:13:02,120 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 13:13:02,120 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 13:13:02,121 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:13:02,121 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:13:02,122 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 13:13:02,122 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:13:02,122 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:13:02,123 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 13:13:02,123 DEBUG [Listener at jenkins-hbase4.apache.org/38153] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 13:13:02,597 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467386_0006_000001 (auth:SIMPLE) 2023-07-17 13:13:02,791 WARN [Listener at jenkins-hbase4.apache.org/38153] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 13:13:02,794 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-17 13:13:02,796 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-17 13:13:02,911 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 13:13:02,911 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 13:13:03,213 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467386_0007_000001 (auth:SIMPLE) 2023-07-17 13:13:03,702 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 13:13:09,529 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467386_0007_000001 (auth:SIMPLE) 2023-07-17 13:13:11,824 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467386_0007_000001 (auth:SIMPLE) 2023-07-17 13:13:16,526 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467386_0007_000001 (auth:SIMPLE) 2023-07-17 13:13:18,092 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 13:13:18,092 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 13:13:18,109 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:18,109 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 13:13:18,110 INFO [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 13:13:18,110 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-233758021_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:18,110 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(367): hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-17 13:13:18,110 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(367): hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-17 13:13:18,111 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-233758021_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599580870/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599580870/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:18,111 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(367): hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599580870/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-17 13:13:18,111 DEBUG [Listener at jenkins-hbase4.apache.org/38153] snapshot.TestExportSnapshot(367): hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/export-test/export-1689599580870/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-17 13:13:18,117 INFO [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:18,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:18,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:18,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-17 13:13:18,123 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599598123"}]},"ts":"1689599598123"} 2023-07-17 13:13:18,124 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-17 13:13:18,126 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-17 13:13:18,127 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=13cec0c5711eee3f91574c76e3b40468, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=04118754c4bfa2087d3d1fb7c3bd84f1, UNASSIGN}] 2023-07-17 13:13:18,130 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=13cec0c5711eee3f91574c76e3b40468, UNASSIGN 2023-07-17 13:13:18,130 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=04118754c4bfa2087d3d1fb7c3bd84f1, UNASSIGN 2023-07-17 13:13:18,131 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=13cec0c5711eee3f91574c76e3b40468, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:13:18,131 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=04118754c4bfa2087d3d1fb7c3bd84f1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:13:18,131 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689599578402.13cec0c5711eee3f91574c76e3b40468.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689599598130"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599598130"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599598130"}]},"ts":"1689599598130"} 2023-07-17 13:13:18,131 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689599578402.04118754c4bfa2087d3d1fb7c3bd84f1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689599598131"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599598131"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599598131"}]},"ts":"1689599598131"} 2023-07-17 13:13:18,133 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 13cec0c5711eee3f91574c76e3b40468, server=jenkins-hbase4.apache.org,42601,1689599458269}] 2023-07-17 13:13:18,133 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 04118754c4bfa2087d3d1fb7c3bd84f1, server=jenkins-hbase4.apache.org,43575,1689599458131}] 2023-07-17 13:13:18,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-17 13:13:18,285 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 13cec0c5711eee3f91574c76e3b40468 2023-07-17 13:13:18,285 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 04118754c4bfa2087d3d1fb7c3bd84f1 2023-07-17 13:13:18,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 13cec0c5711eee3f91574c76e3b40468, disabling compactions & flushes 2023-07-17 13:13:18,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 04118754c4bfa2087d3d1fb7c3bd84f1, disabling compactions & flushes 2023-07-17 13:13:18,286 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689599578402.13cec0c5711eee3f91574c76e3b40468. 2023-07-17 13:13:18,286 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689599578402.04118754c4bfa2087d3d1fb7c3bd84f1. 2023-07-17 13:13:18,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689599578402.04118754c4bfa2087d3d1fb7c3bd84f1. 2023-07-17 13:13:18,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689599578402.04118754c4bfa2087d3d1fb7c3bd84f1. after waiting 0 ms 2023-07-17 13:13:18,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689599578402.04118754c4bfa2087d3d1fb7c3bd84f1. 2023-07-17 13:13:18,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689599578402.13cec0c5711eee3f91574c76e3b40468. 2023-07-17 13:13:18,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689599578402.13cec0c5711eee3f91574c76e3b40468. after waiting 0 ms 2023-07-17 13:13:18,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689599578402.13cec0c5711eee3f91574c76e3b40468. 2023-07-17 13:13:18,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithSkipTmp/04118754c4bfa2087d3d1fb7c3bd84f1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 13:13:18,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/default/testtb-testExportFileSystemStateWithSkipTmp/13cec0c5711eee3f91574c76e3b40468/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 13:13:18,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:13:18,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:13:18,300 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689599578402.13cec0c5711eee3f91574c76e3b40468. 2023-07-17 13:13:18,300 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689599578402.04118754c4bfa2087d3d1fb7c3bd84f1. 2023-07-17 13:13:18,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 04118754c4bfa2087d3d1fb7c3bd84f1: 2023-07-17 13:13:18,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 13cec0c5711eee3f91574c76e3b40468: 2023-07-17 13:13:18,302 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 04118754c4bfa2087d3d1fb7c3bd84f1 2023-07-17 13:13:18,302 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=04118754c4bfa2087d3d1fb7c3bd84f1, regionState=CLOSED 2023-07-17 13:13:18,302 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 13cec0c5711eee3f91574c76e3b40468 2023-07-17 13:13:18,303 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689599578402.04118754c4bfa2087d3d1fb7c3bd84f1.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689599598302"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599598302"}]},"ts":"1689599598302"} 2023-07-17 13:13:18,303 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=13cec0c5711eee3f91574c76e3b40468, regionState=CLOSED 2023-07-17 13:13:18,303 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689599578402.13cec0c5711eee3f91574c76e3b40468.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689599598303"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599598303"}]},"ts":"1689599598303"} 2023-07-17 13:13:18,306 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-17 13:13:18,306 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 04118754c4bfa2087d3d1fb7c3bd84f1, server=jenkins-hbase4.apache.org,43575,1689599458131 in 171 msec 2023-07-17 13:13:18,307 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-17 13:13:18,307 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 13cec0c5711eee3f91574c76e3b40468, server=jenkins-hbase4.apache.org,42601,1689599458269 in 172 msec 2023-07-17 13:13:18,307 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=04118754c4bfa2087d3d1fb7c3bd84f1, UNASSIGN in 179 msec 2023-07-17 13:13:18,308 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-17 13:13:18,308 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=13cec0c5711eee3f91574c76e3b40468, UNASSIGN in 180 msec 2023-07-17 13:13:18,309 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599598309"}]},"ts":"1689599598309"} 2023-07-17 13:13:18,310 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-17 13:13:18,311 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-17 13:13:18,313 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 194 msec 2023-07-17 13:13:18,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-17 13:13:18,426 INFO [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-17 13:13:18,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:18,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:18,431 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:18,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:18,435 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43575] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:18,437 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:18,439 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:18,439 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:18,439 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:18,440 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:18,440 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-17 13:13:18,440 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-17 13:13:18,440 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-17 13:13:18,440 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-17 13:13:18,442 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:18,442 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:13:18,442 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:18,442 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:13:18,442 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:18,442 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:13:18,442 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:18,442 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:13:18,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-17 13:13:18,457 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/13cec0c5711eee3f91574c76e3b40468 2023-07-17 13:13:18,465 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/04118754c4bfa2087d3d1fb7c3bd84f1 2023-07-17 13:13:18,466 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/13cec0c5711eee3f91574c76e3b40468/cf, FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/13cec0c5711eee3f91574c76e3b40468/recovered.edits] 2023-07-17 13:13:18,468 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/04118754c4bfa2087d3d1fb7c3bd84f1/cf, FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/04118754c4bfa2087d3d1fb7c3bd84f1/recovered.edits] 2023-07-17 13:13:18,475 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/13cec0c5711eee3f91574c76e3b40468/cf/eed989c7384846f385b810927071d0bc to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/13cec0c5711eee3f91574c76e3b40468/cf/eed989c7384846f385b810927071d0bc 2023-07-17 13:13:18,476 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/04118754c4bfa2087d3d1fb7c3bd84f1/cf/fb0ca69948694bbaa870c4f5ce8bae5f to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/04118754c4bfa2087d3d1fb7c3bd84f1/cf/fb0ca69948694bbaa870c4f5ce8bae5f 2023-07-17 13:13:18,480 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/04118754c4bfa2087d3d1fb7c3bd84f1/recovered.edits/9.seqid to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/04118754c4bfa2087d3d1fb7c3bd84f1/recovered.edits/9.seqid 2023-07-17 13:13:18,481 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/04118754c4bfa2087d3d1fb7c3bd84f1 2023-07-17 13:13:18,483 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/13cec0c5711eee3f91574c76e3b40468/recovered.edits/9.seqid to hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/13cec0c5711eee3f91574c76e3b40468/recovered.edits/9.seqid 2023-07-17 13:13:18,484 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/13cec0c5711eee3f91574c76e3b40468 2023-07-17 13:13:18,484 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-17 13:13:18,487 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:18,489 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-17 13:13:18,495 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-17 13:13:18,496 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:18,496 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-17 13:13:18,496 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689599578402.13cec0c5711eee3f91574c76e3b40468.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689599598496"}]},"ts":"9223372036854775807"} 2023-07-17 13:13:18,496 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689599578402.04118754c4bfa2087d3d1fb7c3bd84f1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689599598496"}]},"ts":"9223372036854775807"} 2023-07-17 13:13:18,504 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-17 13:13:18,504 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 13cec0c5711eee3f91574c76e3b40468, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689599578402.13cec0c5711eee3f91574c76e3b40468.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 04118754c4bfa2087d3d1fb7c3bd84f1, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689599578402.04118754c4bfa2087d3d1fb7c3bd84f1.', STARTKEY => '1', ENDKEY => ''}] 2023-07-17 13:13:18,504 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-17 13:13:18,504 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689599598504"}]},"ts":"9223372036854775807"} 2023-07-17 13:13:18,506 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-17 13:13:18,508 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:18,509 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 81 msec 2023-07-17 13:13:18,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-17 13:13:18,544 INFO [Listener at jenkins-hbase4.apache.org/38153] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-17 13:13:18,551 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-17 13:13:18,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:18,554 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-17 13:13:18,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44069] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:18,587 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765 (was 765), OpenFileDescriptor=907 (was 921), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=750 (was 705) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 183), AvailableMemoryMB=1370 (was 1525) 2023-07-17 13:13:18,587 WARN [Listener at jenkins-hbase4.apache.org/38153] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-17 13:13:18,587 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-17 13:13:18,602 INFO [Listener at jenkins-hbase4.apache.org/38153] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-17 13:13:18,715 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689599467386_0007_01_000001 is : 143 2023-07-17 13:13:23,871 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 13:13:32,729 INFO [Listener at jenkins-hbase4.apache.org/38153] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-17 13:13:46,851 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-17 13:13:46,851 INFO [Listener at jenkins-hbase4.apache.org/38153] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-17 13:13:46,975 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-17 13:13:46,992 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-17 13:13:46,994 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-17 13:13:47,033 INFO [Listener at jenkins-hbase4.apache.org/38153] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-17 13:13:47,139 ERROR [Thread[Thread-383,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-17 13:13:47,143 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-17 13:13:47,143 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-17 13:13:47,143 INFO [Listener at jenkins-hbase4.apache.org/38153] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-17 13:13:47,143 DEBUG [Listener at jenkins-hbase4.apache.org/38153] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1f336f33 to 127.0.0.1:56233 2023-07-17 13:13:47,143 DEBUG [Listener at jenkins-hbase4.apache.org/38153] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:13:47,143 DEBUG [Listener at jenkins-hbase4.apache.org/38153] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-17 13:13:47,143 DEBUG [Listener at jenkins-hbase4.apache.org/38153] util.JVMClusterUtil(257): Found active master hash=628462355, stopped=false 2023-07-17 13:13:47,144 DEBUG [Listener at jenkins-hbase4.apache.org/38153] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:13:47,144 DEBUG [Listener at jenkins-hbase4.apache.org/38153] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-17 13:13:47,144 INFO [Listener at jenkins-hbase4.apache.org/38153] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,44069,1689599456641 2023-07-17 13:13:47,237 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-17 13:13:47,237 INFO [Listener at jenkins-hbase4.apache.org/38153] procedure2.ProcedureExecutor(629): Stopping 2023-07-17 13:13:47,237 DEBUG [Listener at jenkins-hbase4.apache.org/38153] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x49e62556 to 127.0.0.1:56233 2023-07-17 13:13:47,237 DEBUG [Listener at jenkins-hbase4.apache.org/38153] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:13:47,238 INFO [Listener at jenkins-hbase4.apache.org/38153] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43575,1689599458131' ***** 2023-07-17 13:13:47,238 DEBUG [Listener at jenkins-hbase4.apache.org/38153] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:13:47,238 INFO [Listener at jenkins-hbase4.apache.org/38153] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-17 13:13:47,238 INFO [Listener at jenkins-hbase4.apache.org/38153] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45883,1689599458200' ***** 2023-07-17 13:13:47,238 DEBUG [Listener at jenkins-hbase4.apache.org/38153] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:13:47,238 INFO [Listener at jenkins-hbase4.apache.org/38153] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-17 13:13:47,238 INFO [Listener at jenkins-hbase4.apache.org/38153] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42601,1689599458269' ***** 2023-07-17 13:13:47,238 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-17 13:13:47,239 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-17 13:13:47,239 INFO [RS:0;jenkins-hbase4:43575] regionserver.HeapMemoryManager(220): Stopping 2023-07-17 13:13:47,240 INFO [RS:0;jenkins-hbase4:43575] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-17 13:13:47,240 INFO [RS:0;jenkins-hbase4:43575] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-17 13:13:47,240 INFO [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(3305): Received CLOSE for 9f7c4b8f7e4feeacebf9d9bcd1ae3d42 2023-07-17 13:13:47,240 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 13:13:47,240 INFO [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:13:47,240 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 13:13:47,240 DEBUG [RS:0;jenkins-hbase4:43575] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x310dc82a to 127.0.0.1:56233 2023-07-17 13:13:47,240 DEBUG [RS:0;jenkins-hbase4:43575] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:13:47,237 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 13:13:47,237 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-17 13:13:47,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9f7c4b8f7e4feeacebf9d9bcd1ae3d42, disabling compactions & flushes 2023-07-17 13:13:47,242 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689599462090.9f7c4b8f7e4feeacebf9d9bcd1ae3d42. 2023-07-17 13:13:47,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689599462090.9f7c4b8f7e4feeacebf9d9bcd1ae3d42. 2023-07-17 13:13:47,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689599462090.9f7c4b8f7e4feeacebf9d9bcd1ae3d42. after waiting 0 ms 2023-07-17 13:13:47,243 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689599462090.9f7c4b8f7e4feeacebf9d9bcd1ae3d42. 2023-07-17 13:13:47,243 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 9f7c4b8f7e4feeacebf9d9bcd1ae3d42 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-17 13:13:47,240 INFO [RS:1;jenkins-hbase4:45883] regionserver.HeapMemoryManager(220): Stopping 2023-07-17 13:13:47,243 INFO [RS:1;jenkins-hbase4:45883] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-17 13:13:47,243 INFO [RS:1;jenkins-hbase4:45883] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-17 13:13:47,243 INFO [RS:1;jenkins-hbase4:45883] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:13:47,243 DEBUG [RS:1;jenkins-hbase4:45883] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x01fd1575 to 127.0.0.1:56233 2023-07-17 13:13:47,243 DEBUG [RS:1;jenkins-hbase4:45883] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:13:47,243 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-17 13:13:47,240 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 13:13:47,240 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-17 13:13:47,238 DEBUG [Listener at jenkins-hbase4.apache.org/38153] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:13:47,246 INFO [Listener at jenkins-hbase4.apache.org/38153] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-17 13:13:47,246 INFO [RS:2;jenkins-hbase4:42601] regionserver.HeapMemoryManager(220): Stopping 2023-07-17 13:13:47,246 INFO [RS:2;jenkins-hbase4:42601] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-17 13:13:47,246 INFO [RS:2;jenkins-hbase4:42601] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-17 13:13:47,246 INFO [RS:2;jenkins-hbase4:42601] regionserver.HRegionServer(3305): Received CLOSE for d5e24905ea8c385abbebf6a0b4d28aba 2023-07-17 13:13:47,247 INFO [RS:2;jenkins-hbase4:42601] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:13:47,247 DEBUG [RS:2;jenkins-hbase4:42601] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x646d20c6 to 127.0.0.1:56233 2023-07-17 13:13:47,247 DEBUG [RS:2;jenkins-hbase4:42601] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:13:47,247 INFO [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-17 13:13:47,247 DEBUG [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(1478): Online Regions={9f7c4b8f7e4feeacebf9d9bcd1ae3d42=hbase:acl,,1689599462090.9f7c4b8f7e4feeacebf9d9bcd1ae3d42.} 2023-07-17 13:13:47,247 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-17 13:13:47,248 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 13:13:47,248 DEBUG [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(1504): Waiting on 9f7c4b8f7e4feeacebf9d9bcd1ae3d42 2023-07-17 13:13:47,249 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d5e24905ea8c385abbebf6a0b4d28aba, disabling compactions & flushes 2023-07-17 13:13:47,249 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689599461201.d5e24905ea8c385abbebf6a0b4d28aba. 2023-07-17 13:13:47,249 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689599461201.d5e24905ea8c385abbebf6a0b4d28aba. 2023-07-17 13:13:47,249 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689599461201.d5e24905ea8c385abbebf6a0b4d28aba. after waiting 0 ms 2023-07-17 13:13:47,249 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689599461201.d5e24905ea8c385abbebf6a0b4d28aba. 2023-07-17 13:13:47,249 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing d5e24905ea8c385abbebf6a0b4d28aba 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-17 13:13:47,252 INFO [RS:1;jenkins-hbase4:45883] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45883,1689599458200; all regions closed. 2023-07-17 13:13:47,252 INFO [RS:2;jenkins-hbase4:42601] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-17 13:13:47,252 INFO [RS:2;jenkins-hbase4:42601] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-17 13:13:47,252 INFO [RS:2;jenkins-hbase4:42601] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-17 13:13:47,252 INFO [RS:2;jenkins-hbase4:42601] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-17 13:13:47,269 INFO [RS:2;jenkins-hbase4:42601] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-17 13:13:47,269 DEBUG [RS:2;jenkins-hbase4:42601] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, d5e24905ea8c385abbebf6a0b4d28aba=hbase:namespace,,1689599461201.d5e24905ea8c385abbebf6a0b4d28aba.} 2023-07-17 13:13:47,269 DEBUG [RS:2;jenkins-hbase4:42601] regionserver.HRegionServer(1504): Waiting on 1588230740, d5e24905ea8c385abbebf6a0b4d28aba 2023-07-17 13:13:47,302 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-17 13:13:47,303 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-17 13:13:47,303 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-17 13:13:47,303 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-17 13:13:47,304 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-17 13:13:47,304 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-17 13:13:47,309 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-17 13:13:47,309 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-17 13:13:47,309 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-17 13:13:47,354 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-17 13:13:47,355 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-17 13:13:47,359 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-17 13:13:47,359 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-17 13:13:47,362 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-17 13:13:47,362 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-17 13:13:47,388 DEBUG [RS:1;jenkins-hbase4:45883] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/oldWALs 2023-07-17 13:13:47,388 INFO [RS:1;jenkins-hbase4:45883] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45883%2C1689599458200:(num 1689599460565) 2023-07-17 13:13:47,388 DEBUG [RS:1;jenkins-hbase4:45883] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:13:47,388 INFO [RS:1;jenkins-hbase4:45883] regionserver.LeaseManager(133): Closed leases 2023-07-17 13:13:47,396 INFO [RS:1;jenkins-hbase4:45883] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-17 13:13:47,397 INFO [RS:1;jenkins-hbase4:45883] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-17 13:13:47,397 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-17 13:13:47,397 INFO [RS:1;jenkins-hbase4:45883] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-17 13:13:47,397 INFO [RS:1;jenkins-hbase4:45883] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-17 13:13:47,399 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/acl/9f7c4b8f7e4feeacebf9d9bcd1ae3d42/.tmp/l/ff96e0c2ccc24fa797a2a7cafccd1c7b 2023-07-17 13:13:47,400 INFO [RS:1;jenkins-hbase4:45883] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45883 2023-07-17 13:13:47,404 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/namespace/d5e24905ea8c385abbebf6a0b4d28aba/.tmp/info/2cb13c75e2c74979bd5adfa2a7b75920 2023-07-17 13:13:47,412 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ff96e0c2ccc24fa797a2a7cafccd1c7b 2023-07-17 13:13:47,413 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/acl/9f7c4b8f7e4feeacebf9d9bcd1ae3d42/.tmp/l/ff96e0c2ccc24fa797a2a7cafccd1c7b as hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/acl/9f7c4b8f7e4feeacebf9d9bcd1ae3d42/l/ff96e0c2ccc24fa797a2a7cafccd1c7b 2023-07-17 13:13:47,415 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/meta/1588230740/.tmp/info/129470cbf2cd490fbf957441781daa3d 2023-07-17 13:13:47,421 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ff96e0c2ccc24fa797a2a7cafccd1c7b 2023-07-17 13:13:47,421 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/acl/9f7c4b8f7e4feeacebf9d9bcd1ae3d42/l/ff96e0c2ccc24fa797a2a7cafccd1c7b, entries=7, sequenceid=18, filesize=5.2 K 2023-07-17 13:13:47,423 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 9f7c4b8f7e4feeacebf9d9bcd1ae3d42 in 180ms, sequenceid=18, compaction requested=false 2023-07-17 13:13:47,435 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 129470cbf2cd490fbf957441781daa3d 2023-07-17 13:13:47,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/namespace/d5e24905ea8c385abbebf6a0b4d28aba/.tmp/info/2cb13c75e2c74979bd5adfa2a7b75920 as hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/namespace/d5e24905ea8c385abbebf6a0b4d28aba/info/2cb13c75e2c74979bd5adfa2a7b75920 2023-07-17 13:13:47,442 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/namespace/d5e24905ea8c385abbebf6a0b4d28aba/info/2cb13c75e2c74979bd5adfa2a7b75920, entries=2, sequenceid=6, filesize=4.8 K 2023-07-17 13:13:47,443 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for d5e24905ea8c385abbebf6a0b4d28aba in 194ms, sequenceid=6, compaction requested=false 2023-07-17 13:13:47,448 DEBUG [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(1504): Waiting on 9f7c4b8f7e4feeacebf9d9bcd1ae3d42 2023-07-17 13:13:47,469 DEBUG [RS:2;jenkins-hbase4:42601] regionserver.HRegionServer(1504): Waiting on 1588230740, d5e24905ea8c385abbebf6a0b4d28aba 2023-07-17 13:13:47,474 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/acl/9f7c4b8f7e4feeacebf9d9bcd1ae3d42/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-17 13:13:47,478 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/namespace/d5e24905ea8c385abbebf6a0b4d28aba/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 13:13:47,478 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:13:47,480 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689599462090.9f7c4b8f7e4feeacebf9d9bcd1ae3d42. 2023-07-17 13:13:47,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9f7c4b8f7e4feeacebf9d9bcd1ae3d42: 2023-07-17 13:13:47,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689599462090.9f7c4b8f7e4feeacebf9d9bcd1ae3d42. 2023-07-17 13:13:47,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:13:47,483 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689599461201.d5e24905ea8c385abbebf6a0b4d28aba. 2023-07-17 13:13:47,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d5e24905ea8c385abbebf6a0b4d28aba: 2023-07-17 13:13:47,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689599461201.d5e24905ea8c385abbebf6a0b4d28aba. 2023-07-17 13:13:47,484 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:13:47,484 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 13:13:47,484 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 13:13:47,484 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:13:47,484 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45883,1689599458200 2023-07-17 13:13:47,484 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 13:13:47,485 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 13:13:47,487 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45883,1689599458200] 2023-07-17 13:13:47,497 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45883,1689599458200; numProcessing=1 2023-07-17 13:13:47,501 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/meta/1588230740/.tmp/rep_barrier/d7c77cc671634833a423832c03034348 2023-07-17 13:13:47,505 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d7c77cc671634833a423832c03034348 2023-07-17 13:13:47,528 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/meta/1588230740/.tmp/table/e49cf37f57d645f994974f3e21681dd9 2023-07-17 13:13:47,536 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e49cf37f57d645f994974f3e21681dd9 2023-07-17 13:13:47,537 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/meta/1588230740/.tmp/info/129470cbf2cd490fbf957441781daa3d as hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/meta/1588230740/info/129470cbf2cd490fbf957441781daa3d 2023-07-17 13:13:47,564 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 129470cbf2cd490fbf957441781daa3d 2023-07-17 13:13:47,564 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/meta/1588230740/info/129470cbf2cd490fbf957441781daa3d, entries=48, sequenceid=131, filesize=10.3 K 2023-07-17 13:13:47,565 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/meta/1588230740/.tmp/rep_barrier/d7c77cc671634833a423832c03034348 as hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/meta/1588230740/rep_barrier/d7c77cc671634833a423832c03034348 2023-07-17 13:13:47,570 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d7c77cc671634833a423832c03034348 2023-07-17 13:13:47,570 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/meta/1588230740/rep_barrier/d7c77cc671634833a423832c03034348, entries=13, sequenceid=131, filesize=6.4 K 2023-07-17 13:13:47,571 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/meta/1588230740/.tmp/table/e49cf37f57d645f994974f3e21681dd9 as hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/meta/1588230740/table/e49cf37f57d645f994974f3e21681dd9 2023-07-17 13:13:47,575 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e49cf37f57d645f994974f3e21681dd9 2023-07-17 13:13:47,576 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/meta/1588230740/table/e49cf37f57d645f994974f3e21681dd9, entries=24, sequenceid=131, filesize=6.9 K 2023-07-17 13:13:47,577 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 273ms, sequenceid=131, compaction requested=false 2023-07-17 13:13:47,599 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45883,1689599458200 already deleted, retry=false 2023-07-17 13:13:47,599 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45883,1689599458200 expired; onlineServers=2 2023-07-17 13:13:47,610 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-17 13:13:47,611 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:13:47,611 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-17 13:13:47,612 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-17 13:13:47,612 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-17 13:13:47,612 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-17 13:13:47,637 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 13:13:47,637 INFO [RS:1;jenkins-hbase4:45883] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45883,1689599458200; zookeeper connection closed. 2023-07-17 13:13:47,637 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:45883-0x101736834af0002, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 13:13:47,638 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@335021ae] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@335021ae 2023-07-17 13:13:47,648 INFO [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43575,1689599458131; all regions closed. 2023-07-17 13:13:47,655 DEBUG [RS:0;jenkins-hbase4:43575] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/oldWALs 2023-07-17 13:13:47,655 INFO [RS:0;jenkins-hbase4:43575] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43575%2C1689599458131:(num 1689599460565) 2023-07-17 13:13:47,655 DEBUG [RS:0;jenkins-hbase4:43575] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:13:47,655 INFO [RS:0;jenkins-hbase4:43575] regionserver.LeaseManager(133): Closed leases 2023-07-17 13:13:47,655 INFO [RS:0;jenkins-hbase4:43575] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-17 13:13:47,656 INFO [RS:0;jenkins-hbase4:43575] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-17 13:13:47,656 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-17 13:13:47,656 INFO [RS:0;jenkins-hbase4:43575] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-17 13:13:47,656 INFO [RS:0;jenkins-hbase4:43575] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-17 13:13:47,657 INFO [RS:0;jenkins-hbase4:43575] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43575 2023-07-17 13:13:47,670 INFO [RS:2;jenkins-hbase4:42601] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42601,1689599458269; all regions closed. 2023-07-17 13:13:47,677 DEBUG [RS:2;jenkins-hbase4:42601] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/oldWALs 2023-07-17 13:13:47,677 INFO [RS:2;jenkins-hbase4:42601] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42601%2C1689599458269.meta:.meta(num 1689599460784) 2023-07-17 13:13:47,683 DEBUG [RS:2;jenkins-hbase4:42601] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/oldWALs 2023-07-17 13:13:47,684 INFO [RS:2;jenkins-hbase4:42601] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42601%2C1689599458269:(num 1689599460564) 2023-07-17 13:13:47,684 DEBUG [RS:2;jenkins-hbase4:42601] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:13:47,684 INFO [RS:2;jenkins-hbase4:42601] regionserver.LeaseManager(133): Closed leases 2023-07-17 13:13:47,684 INFO [RS:2;jenkins-hbase4:42601] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-17 13:13:47,684 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-17 13:13:47,685 INFO [RS:2;jenkins-hbase4:42601] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42601 2023-07-17 13:13:47,714 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 13:13:47,714 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:13:47,714 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43575,1689599458131 2023-07-17 13:13:47,768 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:13:47,768 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42601,1689599458269] 2023-07-17 13:13:47,768 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42601,1689599458269 2023-07-17 13:13:47,768 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42601,1689599458269; numProcessing=2 2023-07-17 13:13:47,867 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42601,1689599458269 already deleted, retry=false 2023-07-17 13:13:47,868 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42601,1689599458269 expired; onlineServers=1 2023-07-17 13:13:47,868 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43575,1689599458131] 2023-07-17 13:13:47,868 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43575,1689599458131; numProcessing=3 2023-07-17 13:13:47,922 INFO [RS:0;jenkins-hbase4:43575] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43575,1689599458131; zookeeper connection closed. 2023-07-17 13:13:47,922 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 13:13:47,922 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:43575-0x101736834af0001, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 13:13:47,922 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1b471c7c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1b471c7c 2023-07-17 13:13:47,969 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43575,1689599458131 already deleted, retry=false 2023-07-17 13:13:47,969 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43575,1689599458131 expired; onlineServers=0 2023-07-17 13:13:47,969 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,44069,1689599456641' ***** 2023-07-17 13:13:47,969 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-17 13:13:47,969 DEBUG [M:0;jenkins-hbase4:44069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64489928, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-17 13:13:47,970 INFO [M:0;jenkins-hbase4:44069] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,44069,1689599456641 2023-07-17 13:13:47,970 INFO [M:0;jenkins-hbase4:44069] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,44069,1689599456641; all regions closed. 2023-07-17 13:13:47,970 DEBUG [M:0;jenkins-hbase4:44069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:13:47,970 DEBUG [M:0;jenkins-hbase4:44069] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-17 13:13:47,970 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-17 13:13:47,970 DEBUG [M:0;jenkins-hbase4:44069] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-17 13:13:47,970 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689599460004] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689599460004,5,FailOnTimeoutGroup] 2023-07-17 13:13:47,970 INFO [M:0;jenkins-hbase4:44069] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-17 13:13:47,970 INFO [M:0;jenkins-hbase4:44069] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-17 13:13:47,970 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689599460002] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689599460002,5,FailOnTimeoutGroup] 2023-07-17 13:13:47,971 INFO [M:0;jenkins-hbase4:44069] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-17 13:13:47,971 DEBUG [M:0;jenkins-hbase4:44069] master.HMaster(1512): Stopping service threads 2023-07-17 13:13:47,971 INFO [M:0;jenkins-hbase4:44069] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-17 13:13:47,971 ERROR [M:0;jenkins-hbase4:44069] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-17 13:13:47,972 INFO [M:0;jenkins-hbase4:44069] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-17 13:13:47,972 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-17 13:13:48,022 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 13:13:48,022 INFO [RS:2;jenkins-hbase4:42601] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42601,1689599458269; zookeeper connection closed. 2023-07-17 13:13:48,022 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): regionserver:42601-0x101736834af0003, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 13:13:48,022 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7c0713af] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7c0713af 2023-07-17 13:13:48,023 INFO [Listener at jenkins-hbase4.apache.org/38153] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-17 13:13:48,052 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-17 13:13:48,052 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 13:13:48,052 DEBUG [M:0;jenkins-hbase4:44069] zookeeper.ZKUtil(398): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-17 13:13:48,052 WARN [M:0;jenkins-hbase4:44069] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-17 13:13:48,052 INFO [M:0;jenkins-hbase4:44069] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-17 13:13:48,053 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-17 13:13:48,053 INFO [M:0;jenkins-hbase4:44069] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-17 13:13:48,053 DEBUG [M:0;jenkins-hbase4:44069] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-17 13:13:48,053 INFO [M:0;jenkins-hbase4:44069] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 13:13:48,053 DEBUG [M:0;jenkins-hbase4:44069] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 13:13:48,053 DEBUG [M:0;jenkins-hbase4:44069] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-17 13:13:48,054 DEBUG [M:0;jenkins-hbase4:44069] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 13:13:48,054 INFO [M:0;jenkins-hbase4:44069] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.38 KB heapSize=449.63 KB 2023-07-17 13:13:48,071 INFO [M:0;jenkins-hbase4:44069] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.38 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/98bc18b5ef3642c890b46967f9133e65 2023-07-17 13:13:48,075 INFO [M:0;jenkins-hbase4:44069] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 98bc18b5ef3642c890b46967f9133e65 2023-07-17 13:13:48,076 DEBUG [M:0;jenkins-hbase4:44069] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/98bc18b5ef3642c890b46967f9133e65 as hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/98bc18b5ef3642c890b46967f9133e65 2023-07-17 13:13:48,079 INFO [M:0;jenkins-hbase4:44069] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 98bc18b5ef3642c890b46967f9133e65 2023-07-17 13:13:48,079 INFO [M:0;jenkins-hbase4:44069] regionserver.HStore(1080): Added hdfs://localhost:37401/user/jenkins/test-data/aacc62f3-f02c-7e02-f569-50fa53abdb7b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/98bc18b5ef3642c890b46967f9133e65, entries=119, sequenceid=899, filesize=28.5 K 2023-07-17 13:13:48,080 INFO [M:0;jenkins-hbase4:44069] regionserver.HRegion(2948): Finished flush of dataSize ~373.38 KB/382342, heapSize ~449.62 KB/460408, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 26ms, sequenceid=899, compaction requested=false 2023-07-17 13:13:48,082 INFO [M:0;jenkins-hbase4:44069] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 13:13:48,082 DEBUG [M:0;jenkins-hbase4:44069] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-17 13:13:48,085 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-17 13:13:48,085 INFO [M:0;jenkins-hbase4:44069] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-17 13:13:48,086 INFO [M:0;jenkins-hbase4:44069] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44069 2023-07-17 13:13:48,168 DEBUG [M:0;jenkins-hbase4:44069] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,44069,1689599456641 already deleted, retry=false 2023-07-17 13:13:48,345 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 13:13:48,345 DEBUG [Listener at localhost/40321-EventThread] zookeeper.ZKWatcher(600): master:44069-0x101736834af0000, quorum=127.0.0.1:56233, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 13:13:48,345 INFO [M:0;jenkins-hbase4:44069] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,44069,1689599456641; zookeeper connection closed. 2023-07-17 13:13:48,347 WARN [Listener at jenkins-hbase4.apache.org/38153] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-17 13:13:48,357 INFO [Listener at jenkins-hbase4.apache.org/38153] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-17 13:13:48,461 WARN [BP-379388120-172.31.14.131-1689599452235 heartbeating to localhost/127.0.0.1:37401] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-17 13:13:48,461 WARN [BP-379388120-172.31.14.131-1689599452235 heartbeating to localhost/127.0.0.1:37401] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-379388120-172.31.14.131-1689599452235 (Datanode Uuid a4fc5897-d75b-479e-a243-9809aad1f7b0) service to localhost/127.0.0.1:37401 2023-07-17 13:13:48,463 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/cluster_ebeb3e26-e5ee-6f23-45cc-cbe52345d6d9/dfs/data/data5/current/BP-379388120-172.31.14.131-1689599452235] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-17 13:13:48,463 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/cluster_ebeb3e26-e5ee-6f23-45cc-cbe52345d6d9/dfs/data/data6/current/BP-379388120-172.31.14.131-1689599452235] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-17 13:13:48,465 WARN [Listener at jenkins-hbase4.apache.org/38153] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-17 13:13:48,469 INFO [Listener at jenkins-hbase4.apache.org/38153] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-17 13:13:48,573 WARN [BP-379388120-172.31.14.131-1689599452235 heartbeating to localhost/127.0.0.1:37401] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-17 13:13:48,573 WARN [BP-379388120-172.31.14.131-1689599452235 heartbeating to localhost/127.0.0.1:37401] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-379388120-172.31.14.131-1689599452235 (Datanode Uuid 9c446925-9c0a-4db9-b083-b87fa8e611fb) service to localhost/127.0.0.1:37401 2023-07-17 13:13:48,574 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/cluster_ebeb3e26-e5ee-6f23-45cc-cbe52345d6d9/dfs/data/data3/current/BP-379388120-172.31.14.131-1689599452235] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-17 13:13:48,575 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/cluster_ebeb3e26-e5ee-6f23-45cc-cbe52345d6d9/dfs/data/data4/current/BP-379388120-172.31.14.131-1689599452235] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-17 13:13:48,579 WARN [Listener at jenkins-hbase4.apache.org/38153] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-17 13:13:48,589 INFO [Listener at jenkins-hbase4.apache.org/38153] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-17 13:13:48,592 WARN [BP-379388120-172.31.14.131-1689599452235 heartbeating to localhost/127.0.0.1:37401] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-17 13:13:48,592 WARN [BP-379388120-172.31.14.131-1689599452235 heartbeating to localhost/127.0.0.1:37401] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-379388120-172.31.14.131-1689599452235 (Datanode Uuid a0d503ac-b6f9-4f20-ab6d-6e31c9966656) service to localhost/127.0.0.1:37401 2023-07-17 13:13:48,593 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/cluster_ebeb3e26-e5ee-6f23-45cc-cbe52345d6d9/dfs/data/data1/current/BP-379388120-172.31.14.131-1689599452235] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-17 13:13:48,593 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/10e6e2d9-e780-ab48-9bad-2a7c6e8bc2e0/cluster_ebeb3e26-e5ee-6f23-45cc-cbe52345d6d9/dfs/data/data2/current/BP-379388120-172.31.14.131-1689599452235] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-17 13:13:48,617 INFO [Listener at jenkins-hbase4.apache.org/38153] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-17 13:13:48,652 INFO [Listener at jenkins-hbase4.apache.org/38153] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-17 13:13:48,746 INFO [Listener at jenkins-hbase4.apache.org/38153] hbase.HBaseTestingUtility(1293): Minicluster is down